THE  LOGICAL  FOUNDATIONS 
OF  EVIDENTIAL  REASONING 


Technical  Note  408 


December  20,  1986 
Revised  April  27,  1987 


By:  Enrique  H.  Ruspini 

Artificial  Intelligence  Center 

Computer  Science  and  Technology  Division 


APPROVED  FOR  PUBLIC  RELEASE:  DISTRIBUTION  UNLIMITED 

This  work  was  supported  in  part  by  the  United  States  Army  Signal  Warfare  Center  under 
contract  DAAL02-85-C-0082,  and  in  part  by  the  National  Science  Foundation  under 
contract  DCR-85-13139. 


333  Ravenswood  Ave.  •  Menlo  Park,  CA  94025 
(415)326-6200  •  TWX:  910-373-2046  •  Telex:  334-486 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

27  APR  1987  2  REPORT  TYPE 

3.  DATES  COVERED 

00-04-1987  to  00-04-1987 

4.  TITLE  AND  SUBTITLE 

The  Logical  Foundations  of  Evidential  Reasoning 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

SRI  International, 333  Ravenswood  Avenue, Menlo  Park, CA, 94025 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

15.  SUBIECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF:  17.  LIMITATION  OF 

18.  NUMBER  19a.  NAME  OF 

a.  REPORT  b.  ABSTRACT  c.  THIS  PAGE 

unclassified  unclassified  unclassified 

37 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Abstract 


The  approach  proposed  by  Carnap  for  the  development  of  logical  bases  for  probability  theory  is  in¬ 
vestigated  by  using  formal  structures  that  are  based  on  epistemic  logics.  Epistemic  logics  are  modal  logics 
introduced  to  deal  with  issues  that  are  relevant  to  the  state  of  knowledge  that  rational  agents  have  about 
the  real  world.  The  use  of  epistemic  logics  in  problems  of  analysis  of  evidence  is  justified  by  the  need  to 
distinguish  among  such  notions  as  the  state  of  a  real  system,  the  state  of  knowledge  possessed  by  rational 
agents,  and  the  impact  of  information  on  that  knowledge. 

Carnap’s  method  for  generating  a  universe  of  possible  worlds  is  followed  using  an  enhanced  notion 
of  possible  world  that  encompasses  descriptions  of  knowledge  states.  Within  such  generalized  or  epistemic 
universes,  several  classes  of  sets  are  identified  in  terms  of  the  truth-values  of  propositions  that  describe  either 
the  state  of  the  world  or  the  state  of  knowledge  about  it.  These  classes  of  subsets  have  the  structure  of  a 
sigma  algebra. 

Probabilities  defined  over  one  of  these  sigma  algebras,  called  the  epistemic  algebra,  are  then  shown  to 
have  the  properties  of  the  belief  and  basic  probability  assignment  functions  of  the  Dempster-Shafer  calculus 
of  evidence. 

It  is  also  shown  that  any  extensions  of  a  probability  function  defined  on  the  epistemic  algebra  (repre¬ 
senting  different  states  of  knowledge)  to  the  truth  algebra  (representing  true  states  of  the  real  world)  must 
satisfy  the  interval  probability  bounds  derived  from  the  Dempster-Shafer  theory.  These  bounds  are  also 
shown  to  correspond  to  the  classical  notions  of  lower  and  upper  probability.  Furthermore,  these  constraints 
are  shown  to  be  the  best  possible  bounds,  given  a  specific  state  of  knowledge. 

Finally,  the  problem  of  combining  the  knowledge  that  several  agents  have  about  a  real-world  system  is 
addressed.  Structures  representing  possible  results  of  the  integration  of  that  knowledge  are  introduced  and 
a  general  formula  for  the  combination  of  evidence  is  derived.  From  this  formula  and  certain  probabilistic 
independence  assumptions,  a  generalization  of  the  rule  of  combination  of  Dempster  is  readily  proved.  The 
meaning  of  these  independence  assumptions  is  made  explicit  through  the  insight  provided  by  the  formal 
structures  that  are  used  to  represent  knowledge  and  truth. 

Finally,  simple  cases  of  combination  of  dependent  evidence  are  discussed  as  an  introduction  to  more  ■ 
general  problems  of  general  combination  that  are  examined  in  a  related  paper. 
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I 

INTRODUCTION 


I-l.  Motivation 

The  purpose  of  this  work  is  to  develop  of  formal  theoretical  foundations  that  improve  the  understanding 
of  the  nature  and  usefulness  of  evidential  reasoning  concepts.  These  foundations  have  been  sought  both 
in  mathematical  logic,  as  the  major  conceptual  approach  to  the  study  of  formal  reasoning  systems,  and 
in  probability  theory,  as  the  foremost  multivalued  logic  approach  to  the  analysis  of  issues  related  to  the 
likelihood  of  propositions  as  true  descriptors  of  the  state  of  affairs  in  the  real  world. 

The  approach  proposed  by  Carnap  [3)  for  developing  logical  bases  of  probability  theory  is  extended  here 
to  information  systems  that  model  the  state  of  a  real  system  and  the  state  of  knowledge  that  rational  agents 
have  about  it.  These  systems  [12]  are  important  in  a  number  of  artificial  intelligence  applications  that  are 
concerned  with  the  interpretation  and  analysis  of  imprecise  and  uncertain  evidence  about  the  real  world. 

The  methodology  followed  here  is  also  related  in  several  ways  to  the  probabilistic  logic  approach  of 
Nilsson  [14]  in  its  conception  of  probabilities  as  valuations  over  a  family  of  subsets  of  a  universe  of  possible 
worlds  that  constrain,  to  different  degrees,  the  probability  values  over  other  subsets  not  in  the  family.  The 
major  differences  between  this  work  and  the  probabilistic  logic  approach  are  in  the  use  of  epistemic  concepts 
and  the  derivation  of  global  conditions  for  probability  function  extension  (i.e.,  lower  and  upper  probabilities) , 
as  opposed  to  local  formulas  derived  from  interval  probability  theory  or  from  interpolative  techniques. 

The  logical  approach  to  probabilities  proposed  by  Carnap  considers  the  latter  as  valuations  over  a  uni¬ 
verse  of  possible  worlds.  These  valuations  allow  quantification  of  the  degree  of  support  (called  confirmation 
by  Carnap)  provided  by  certain  propositions  (describing  evidential  knowledge  about  the  world)  for  the  truth 
of  other  propositions  describing  the  state  of  a  real-world  system  of  interest  |4]. 

The  work  presented  here  departs  from  Carnap’s  approach  by  considering  that  evidence  provides  infor¬ 
mation  about  the  truth  of  some  propositions  while  failing  to  give  any  indication  as  to  the  truth  of  others. 
For  example,  the  discovery  of  a  lock  of  hair  at  the  scene  of  a  crime  may  be  helpful  in  identifying  the  criminal 
as  belonging  to  one  or  more  classes  of  suspects  (having  similar  hair),  but  may  be  of  no  use  in  pinpointing 
specific  suspects.  As  shown  by  this  simple  example,  a  piece  of  evidence  enhances  the  state  of  knowledge 
about  the  truth  of  certain  propositions,  rather  than  about  the  truth  of  all  propositions.  At  any  single  step 
in  the  process  of  acquiring  and  analyzing  evidence  it  must  be  recognized  that,  while  the  world  may  be  in  one 
of  several  possible  states,  the  state  of  knowledge  will  generally  not  be  sufficient  to  enable  precise  definition 
of  that  state. 

The  approach  proposed  here,  while  firmly  rooted  in  basic  probability  theory,  recognizes  that  the  ac¬ 
quisition  of  evidence  has  the  potential  of  changing  the  state  of  knowledge  about  the  real  world,  but  not  of 
altering  the  actual  state  of  the  world  itself.  To  properly  model  the  effect  of  such  changes  in  knowledge  state, 
formalisms  must  be  developed  that  make  it  possible  to  model  both  the  state  of  external  systems  and  the 
state  of  knowledge  about  them. 

In  this  work,  this  foundation  is  sought  in  modal  logics  that  augment  standard  propositional  logic  by 
considering  an  epistemic  operator  K  that  represents  the  state  of  knowledge  that  a  rational  agent  has  about 
the  situation  of  a  real-world  system.  These  logics,  originally  studied  by  Hintikka|l],  were  first  applied  to 
artificial  intelligence  problems  by  Moore  [2],  In  epistemic  logics,  propositions  may  not  only  be  true  or  false, 
as  is  the  case  in  classical  logic,  but  may  also  be  known  to  be  true  or  false,  or  they  may  not  be  known 
to  be  either  true  or  false.  Epistemic  logics  have  been  used  to  study  the  knowledge  properties  of  artificial 
intelligence  systems,  having  recently  been  applied  to  the  design  of  intelligent  robots  [12]. 

Instead  of  considering  a  universe  of  ontological  possibilities  (as  was  done  by  Carnap),  each  describing  a 
different  state  of  the  real  world,  in  this  approach  the  corresponding  epistemic  universe  consists  of  descriptions 
of  possible  states  of  the  real  world  as  well  as  of  the  knowledge  rational  agents  have  about  it. 
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Probabilities  defined  in  this  universe  reflect  uncertainty  (derived  as  the  result  of  prior  experience  or 
rational  considerations)  regarding  the  possible  conclusions  that  may  be  derived  from  the  evidence.  In  Car¬ 
nap’s  approach,  on  the  other  hand,  probabilities  must  be  assigned  so  as  to  reflect  the  effect  of  evidence  on 
any  proposition,  irrespective  of  whether  or  not  that  proposition  can  be  related  experimentally  or  rationally 
to  the  actual  contents  of  such  evidence. 

In  this  work,  the  effect  of  evidence  is  represented  as  changes  in  the  state  of  knowledge  of  rational  agents. 
Uncertain  knowledge  is  represented  as  probability  functions  defined  over  a  sigma  algebra  of  subsets  of  the 
epistemic  universe.  The  elements  of  this  set  collection,  called  the  epistemic  algebra,  are  subsets  of  the 
epistemic  universe  that  are  characterized  by  common  epistemic  properties  (i.e.,  the  same  propositions  are 
known  to  be  true).  These  probabilities  are  related  to  similar  functions  defined  over  truth  algebras,  that  are 
subsets  of  possible  worlds  of  the  epistemic  universe  sharing  the  same  ontological  properties,  (i.e.,  the  same 
propositions  about  the  world  are  true  in  each  subset). 

The  major  results  of  this  work  prove  that  this  generalization  of  the  Carnap  approach  validates  the 
mathematical  theory  of  evidence  of  Dempster  and  Shafer  as  the  proper  formalism  for  the  study  of  evidential 
problems.  These  results  include  all  major  theorems  of  Dempster-Shafer  theory,  including  the  rule  of  com¬ 
bination  of  Dempster.  Moreover,  the  insight  provided  by  the  basic  conceptual  structures  introduced  here 
allow  a  clearer  characterization  of  the  semantic  aspects  of  the  Dempster-Shafer  calculus  of  evidence. 

It  is  also  shown  that  probabilities  defined  on  the  epistemic  algebra  induce  lower  and  upper  probabilities 
in  the  truth  algebra  that  are  identical  to  the  well-known  interval  bounds  derived  in  the  Dempster-Shafer 
theory.  These  results  are  also  consistent  with  the  interpretation  of  belief  measurement  advanced  by  Suppes  [5] 
in  his  critique  of  the  axiomatic  approach  of  Savage  [13]. 

It  is  important  to  note  that  these  results  were  obtained  by  simply  Carnap’s  method  to  epistemic  struc¬ 
tures.  Their  derivation  appeals  only  to  basic  concepts  of  probability  theory  and  epistemic  logic.  Prom  this 
standpoint,  Dempster-Shafer  theory  can  be  regarded  as  an  enhancement  of  the  classical  Bayesian  approach 
to  induction  which  is  able  to  distinguish  among  different  knowledge  states. 

1-2.  Presentation  Approach 

A  major  objective  of  this  paper  is  the  development  of  a  comprehensive  understanding  of  epistemic 
issues  that  bridges  the  gap  between  approaches  to  knowledge  representation  and  manipulation  derived  from 
probability  theory,  on  one  hand,  and  mathematical  logic,  on  the  other. 

Because  of  the  reliance  of  different  methods  on  dissimilar  types  of  formalisms  —  those  stressing  contin¬ 
uous  variable  analysis,  in  probabilistic  approaches,  and  those  stressing  discrete  mathematics,  in  the  case  of 
symbolic  logic  —  it  has  been  difficult  to  find  a  common  ground  for  discussion  and  presentation  that  will  be 
readily  understandable  to  persons  who  are  familiar  only  with  the  concepts  and  structures  of  a  single  method¬ 
ology.  To  solve  these  expository  problems  we  have  chosen  to  present  the  basic  constructs  and  tenets  of  each 
discipline  (which  are,  of  course,  well  known  to  specialists  on  both  sides)  before  proceeding  to  interrelate 
them  within  the  framework  provided  by  the  concept  of  epistemic  universe. 

To  facilitate  the  understanding  of  certain  issues,  we  have  also  introduced  some  simplifications,  that,  if 
viewed  solely  from  the  perspective  of  the  results  presented  herein,  are  actually  unnecessary.  For  example,  the 
assumption  of  finite  universes  and  subset  algebras  is  intended  to  avoid  some  of  the  complexities  introduced 
by  the  infinite  universes  and  sigma  algebras.  The  results  can,  however,  be  readily  extended  in  ways  that  do 
not  constrain  their  essential  validity. 
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1-3.  Organization 

This  work  is  divided  into  six  sections  beginning  with  this  introduction. 

Section  II  presents  the  basic  concepts  and  axioms  of  epistemic  logic  that  underlie  the  concept  of  epistemic 
universe.  The  important  distinction  between  necessary  implication  (or  entailment)  and  ordinary  implication 
is  also  discussed  so  as  to  differentiate  implications  that  are  valid  in  every  possible  world  from  those  that  are 
true  only  in  some  possible  worlds. 

The  major  result  presented  in  this  section  states  that  the  epistemic  universe  may  be  partitioned  into 
a  family  of  epistemically  equivalent  disjoint  subsets.  Each  of  these  sets  is  characterized  by  the  fact  that 
propositions  known  to  be  true  in  one  possible  world  are  tile  same  that  are  known  in  any  other  possible  world 
in  the  same  subset  (i.e,,  both  worlds,  as  far  as  we  know,  are  equivalent).  Furthermore,  these  subsets  can  be 
associated  with  certain  propositions  representing  the  most  detailed  or  specific  knowledge  available  in  each 
possible  world  in  that  epistemic  subset. 

Section  III  introduces  the  basic  concepts  of  probability  theory.  Emphasis  is  placed  on  the  nature  of 
subset  algebras  as  the  domain  of  definition  of  probability  functions.  It  is  shown  that  probabilities  defined 
on  the  epistemic  algebra  (generated  by  the  epistemic  sets  discussed  in  Section  II)  have  the  structure  of  the 
basic  probability  assignments  of  Dempster-Sliafer  theory.  Furthermore,  their  associated  belief  functions  (i.e., 
the  probability  that  a  given  proposition  may  be  known  to  be  true)  are  related  to  these  mass  assignments  by 
the  familiar  equations  of  that  theory.  Also  noteworthy  are  results  assuring  that,  in  the  epistemic  universe, 
probabilities  defined  on  epistemic  algebras  induce  lower  and  upper  probabilities  over  truth  algebras  defining 
interval  bounds  that  are  identical  to  those  derived  in  the  mathematical  theory  of  evidence  of  Dempster  and 
Shafer. 

Section  IV  deals  with  problems  associated  with  combining  the  knowledge  of  two  rational  agents,  each 
dealing  with  a  distinct  (albeit  possibly  the  same)  universe  of  discourse.  Structures  are  introduced  to  represent 
the  agents’  state  of  knowledge  before  and  after  the  two  bodies  of  knowledge  have  been  combined.  The 
principal  result  presented  in  this  section  is  a  general  evidence  combination  formula  that  is  the  basis  for  the 
derivation  of  specific  combination  formulas,  each  corresponding  to  special  assumptions  about  the  nature  of 
the  evidential  bodies  being  combined  and  their  relations. 

Section  V  introduces  the  notion  of  probabilistic  independence.  The  nature  of  the  structures  presented 
in  the  previous  sections  enables  a  clearer  understanding  of  this  important  concept  than  that  found  in  the 
existing  literature.  A  generalization  of  Dempster’s  combination  formula  is  derived  on  the  basis  of  specific 
assumptions  of  independence  of  certain  probabilities. 

Finally,  Section  VI  deals  with  certain  simple  cases  of  combination  of  dependent  evidence.  The  purpose 
of  discussing  them  is  the  presentation  of  general  problems  of  combination  of  dependent  and  conditional 
knowledge  that  are  given  detailed  attention  in  a  related  paper  [15]. 


II 

THE  EPISTEMIC  UNIVERSE 


This  section  presents  the  basic  epistemic  logic  structures  used  to  produce  a  framework  for  the  represen¬ 
tation  of  uncertainties  discussed  in  Section  III.  The  basic  axioms  of  epistemic  logic  are  introduced  to  allow 
description  of  the  epistemic  universe,  i.e.,  a  space  of  possible  states  of  the  real  world  and  of  knowledge  about 
it. 

The  important  notion  of  necessary  implication  is  used,  together  with  the  epistemic  concept  of  accessi¬ 
bility  relation,  to  define  important  classes  of  epistemic  sets;  i.e.  subsets  of  the  epistemic  universe  that  are 
equivalent  with  respect  the  extent  of  their  knowledge.  Similarly,  subsets  of  the  epistemic  universe,  called 
truth  sets,  are  defined  on  the  basis  of  their  common  ontological  properties.  It  will  also  be  proved  below  that 
every  possible  world  in  the  epistemic  universe  is  associated  with  a  unique  sentence  that  describes  the  most 
specific  knowledge  of  the  modeled  system  that  is  represented  in  that  possible  world. 

II' 1.  Epistemic  Logic 
II- 1-1.  Symbols 

(1)  The  special  characters  0  and  <p  are  symbols. 

(2)  Elements  of  a  finite  alphabet  A  are  symbols. 

II-1-2.  Sentences 

Sentences  will  be  denoted  by  script  letters  £  ,7  (sometimes  with  a  subscript).  Sentences  are  defined 
recursively  by  the  following  axioms: 

(51)  If  a  is  a  symbol,  then  it  is  a  sentence. 

(52)  If  £ ,  7  are  sentences,  so  are  £  f\  7  and  £  V  /. 

(53)  If  £  is  a  sentence,  so  is  ->£ . 

(54)  If  £  is  a  sentence,  so  is  K<f . 

(55)  If  £  and  7  are  sentences,  then  £  —*  7  is  a  sentence. 

II-1-3.  Objective  Sentences 

If  £  is  a  sentence  that  does  not  include  the  unary  operator  K,  then  £  is  said  to  be  an  objective  sentence. 
II- 1-4.  Truth  Values 

The  truth  values  are  T  and  F,  denoting  true  and  false,  respectively. 

II-1-5.  Sentence  Space 

The  set  of  all  well-formed  sentences  (henceforth  called  the  sentence  space)  will  be  denoted  $ . 
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n-2.  Epistemic  Worlds 
II-2-1.  Interpretations 

An  interpretation  M>  for  5  is  a  mapping  from  the  sentence  space  S  into  the  set  of  possible  truth  values 
{T,F}. 

A  sentence  £  is  true  in  W  if  and  only  if  W  maps  £  into  the  truth  value  T.  Otherwise  the  sentence  is 
said  to  be  false. 

II-2-2.  Possible  Worlds 

An  interpretation  W  is  a  possible  epistemic  world  (or  simply  a  possible  world)  for  the  sentence  space  S 
if  and  only  if  it  satisfies  the  following  axioms  : 

(Ml)  Axioms  of  ordinary  propositional  logic  with  ©  denoting  a  sentence  that  is  always 
true  and  <p  denoting  a  sentence  that  is  always  false. 

(M2)  If  K.<f  is  true,  then  £  is  true. 

(M3)  If  K£  is  true,  then  KKf  is  true. 

(M4)  If  K(£  — »  7)  is  true,  then  K£  — ►  K/  is  true. 

(M5)  If  f  is  an  axiom,  then  K£  is  an  axiom. 

(M6)  If  -iKf  is  true,  then  K-^Kf  is  true. 

This  axiom  schemata  is  an  enhancement  (by  addition  of  (M6))  of  that  originally  proposed  by  Moore  [2]. 
The  resulting  logical  system  is  equivalent  to  the  modal  logic  system  S5. 

1 1-2- 3.  Remark 

As  is  well  known,  the  truth  of  objective  sentences  in  a  possible  world  H!  is  determined  by  the  truth  of 
sentences  consisting  of  a  single  symbol  by  application  of  the  laws  of  logic  (embodied  in  the  above  schemata). 

The  truth  of  nonobjective  sentences,  however,  while  derivable  from  the  truth  of  other  sentences  in  S, 
will  not  be,  in  general,  a  function  of  the  state  of  knowledge  about  the  truth  of  simpler  propositions  (e.g., 
TL£  and  K./  may  be  false,  but  K(£  V  7)  may  be  true). 

II-2-4.  Universes 

The  space  of  all  possible  worlds  for  S ,  called  the  universe,  will  be  denoted  by  U(S). 

II-3.  Necessary  Truth 
II-3-1.  Logical  Implication 

A  sentence  £  is  said  to  logically  imply  a  sentence  7,  denoted  £  =t>  7,  if  on  the  basis  the  axioms  of 
epistemic  logic,  without  regard  to  the  truth  value  of  other  sentences  that  could  be  possibly  true  or  possibly 
false  (i.e,  not  necessarily  true  or  false),  and  by  the  use  of  rules  of  deduction,  (e.g.,  modus  ponens),  7  can  be 
shown  to  be  true  whenever  £  is  true. 

Clearly,  if  £  is  true  in  a  possible  world  W,  then  7  is  also  true  in  H'.  In  addition,  if  £  =>■  7,  then  £  — *  / 
in  every  possible  world  ~W ,  and  conversely. 


Ruspini 


Logical  Foundations  of  Evidential  Reasoning 


6 


II-3-2.  Semantic  Aspects  of  Logical  Implication 

The  notion  of  logical  implication,  introduced  above,  corresponds  to  Carnap’s  notion  of  necessary  or 
L-impJication  [3,  pp.  11  ff.]. 

Informally  speaking,  the  validity  of  <f  =>-  7  means  that,  solely  on  the  basis  of  the  semantical  rules  of 
the  system  and  without  reference  to  extralinguistic  facts,  the  assumed  truth  of  the  sentence  £  is  sufficient 
to  assure  the  truth  of  the  sentence  7 . 

If,  as  Carnap  points  out,  £  yL  7,  then,  by  definition,  there  exists  a  possible  world  where  £  is  true  and 
where  7  is  false,  The  truth  of  7 ,  therefore,  cannot  be  derived  solely  from  the  truth  of  £  and  the  semantics 
of  the  system.  To  establish  such  truth  extralinguistic  facts  are  required  (i.e.,  the  truth  of  other  sentences 
that  are  themselves  not  necessarily  true). 

The  concept  of  necessary  implication  is  intended  to  capture  the  notion  of  semantic  entaiiment  of  one 
sentence  by  the  other  as  an  inevitable  consequence  of  axiomatic  considerations,  rather  than  resulting  from 
the  mere  fact  that,  in  every  possible  world,  whenever  the  entailing  sentence  is  true,  so  is  the  entailed  sentence. 

It  is  valid,  therefore  (as  will  be  done  below  for  problems  of  knowledge  combination),  to  restrict  the  scope 
of  a  universe  by  eliminating  from  consideration  possible  worlds  in  which  certain  pairs  of  sentences  do  not 
satisfy  some  specific  entaiiment  conditions.  The  semantic  interpretation  of  entaiiment  allows  the  use  of  this 
restriction,  which  would  otherwise  be  improper  (i.e.,  a  possible  world  is  defined  in  terms  of  the  scope  of  the 
class  of  possible  worlds). 

11-3-3.  Necessary  Implications  as  Axioms 

Throughout  this  work  it  will  be  assumed  that,  if  £  =>•  /,  then  £  — ►  7  is  an  axiom  that  is  true  in  every 
possible  world  W  and,  as  required  by  (M5),  it  is  always  known.  This  requirement  is  very  natural;  it  restricts 
our  consideration  of  possible  worlds  to  those  in  which  both  general  laws  of  epistemic  logic  and  specific  truths 
applicable  to  certain  systems  are  both  assumed  to  be  known. 

In  what  follows,  it  will  be  assumed  that,  if  £  =>  7,  then  K[£  — ►  7)  is  true  for  every  possible  world  W 
(hence  K(£  =>  7),  and  K£  =>K7). 

II-3-4.  Logical  Equivalence 

Two  sentences  £  and  7  are  said  to  be  logically  equivalent,  denoted  by  £  &  7,  if  and  only  if  £  =>  7  and 

7=>£. 

II-3-5.  Frames  of  Discernment 

The  quotient  space  of  the  set  of  objective  sentences  by  the  equivalence  relation  will  be  called  a  frame 
of  discernment  and  will  be  denoted  by  <£(S). 

II-4.  Epistemic  States 

II-4-1.  Simple  Epistemic  Equivalence 

Two  possible  worlds  Wi,  W2  for  the  sentence  space  S  are  said  to  be  epistemically  equivalent  (denoted 
Wi  ~  M)?)  if)  for  any  objective  sentence  £ ,  the  sentence  K<£  is  true  in  Wi  if  and  only  if  it  is  also  true  in  IV?. 

It  can  be  readily  verified  that  the  relation  ~  is  an  equivalence  relation  among  possible  worlds  for  S. 
This  relation  is  called  the  accessibility  relation  [2].1 

II-4-2.  Epistemic  Space 

The  quotient  space  of  the  set  Z/(S)  of  all  possible  worlds  for  S  by  the  equivalence  relation  ~  will  be 
called  the  epistemic  space  of  S  (denoted  by  E(S )).  Its  members  are  called  epistemic  states. 

1  This  relation  is  identical  to  the  accessibility  relation  of  modal  logic  only  in  the  case  of  equivalence  relations.  In  our  case, 
this  assumption  is  valid  since  the  underlying  modal  logic  system  is  equivalent  to  S5. 
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II-5.  Most  Specific  Knowledge 

II-5-1.  Existence  and  Uniqueness  of  Most  Specific  Knowledge 

Theorem  (Most  Specific  Knowledge):  There  exists  an  injective  mapping  M  between  the  space  2(5)  of 
all  epistemic  states  and  the  frame  of  discernment  3>(5).  This  mapping  assigns  a  unique  (except  for  logical 
equivalences)  objective  sentence  £  —  M(e)  to  every  epistemic  state  e,  so  that,  for  every  possible  world  TV  in 
e,  and  for  every  objective  sentence  7,  tlie  sentence  K7  is  true  in  TV  if  and  only  if  £=>  7  . 

Proof:  First  note  that,  by  definition,  epistemically  equivalent  possible  worlds  share  a  common  set  of 
objective  sentences  7  such  that  K?  is  true.  Proof  of  the  existence  of  a  sentence  satisfying  the  theorem  thesis 
for  a  possible  world  TV  in  the  epistemic  set  e  is  therefore  equivalent  to  its  proof  for  any  other  possible  world 
TV'  in  e  such  that  TV'  ~  IV.  Furthermore,  such  a  sentence  should  be  the  same  for  all  epistemically  equivalent 
possible  worlds. 

To  see  that  such  a  sentence  exists,  consider  any  possible  world  IV  in  e  and  let 

be  the  set  of  all  objective  sentences  7  in  TV  such  that  K7  is  true.  Let 

£  =  7\  A  7i  A . . . 

Then  €  is  also  objective  and,  by  virtue  of  the  axioms  of  propositional  logic  (relating  truth  values  of  conjuncts 

with  that  of  their  conjunction),  if  £  is  true  in  any  possible  world  IV,  then  so  is  7{,  i  =  1,  2, _  Therefore, 

by  construction,  if  KJ  is  true  in  TV ,  then  £  =>  7.  In  particular,  since  £  =>  £ ,  K<f  is  true  in  TV. 

Conversely,  if  £  =>  7 ,  then,  since  K(£  — ►  7),  it  follows  from  (M4)  that  K/  is  true  in  TV. 

In  addition,  if  e  and  e'  are  two  epistemic  spaces  such  that  M(e)  =  M(e')  =  £ ,  then  any  two  possible 
worlds  in  e  or  e'  share  the  same  set  of  true  sentences  of  the  form  ~K7  where  7  is  objective  (i.e.  those  that 
satisfy  £  =>  7).  Therefore  those  two  worlds  belong  to  the  same  epistemic  space. 

To  prove  that  the  mapping  is  unique,  assume  that  <fi  and  £2  are  two  sentences  that  satisfy  (for  a 
possible  world  TV)  the  thesis  of  the  theorem.  Then  £\  A  £2  is  objective  and  true  and,  by  virtue  of  the 
assumed  properties  of  £\  and  £21  if  follows  that  £1  (£1  A  £2)  and  £2  =>  (£1  A  £2)  are  both  true.  But  then, 

since  (£1  A  £2)  =>  £1  and  (£1  A  £2)  =>  £2,  it  follows  that  £1  and  £2  are  logically  equivalent. 

This  completes  the  proof  of  the  theorem.! 

II-5-2.  Epistemic  Mapping 

If  £  =  M(e),  then  £  is  said  to  be  the  most  specific  objective  sentence  known  in  e.  By  abuse  of  language 
we  shall  also  use  the  notation  M  to  associate  every  possible  world  with  the  most  specific  objective  sentence 
known  in  that  possible  world. 

Conversely,  e(£)  will  denote  the  epistemic  set  containing  all  the  possible  worlds  that  have  as  their 
most  specific  knowledge  the  objective  sentence  £.  Clearly,  e  is  the  inverse  of  M,  mapping  classes  of  logically 
equivalent  objective  sentences  (i.e.,  $(5))  into  classes  of  epistemically  equivalent  possible  worlds  (i.e.,  E(£)). 

It  is  important  to  note,  however,  that  some  epistemic  sets  may  be  empty.  For  example,  since  the  sentence 
<p  is  false  in  every  possible  world,  the  epistemic  set  e(^>)  does  not  contain  a  possible  world. 

II-5-3.  Generalizations  of  the  Most  Specific  Knowledge  Theorem 

Note  that,  although  the  theorem  proved  above  was  concerned  with  the  existence  of  most  specific  objective 
sentences,  the  arguments  used  are  applicable  to  any  class  of  sentences  that  is  closed  under  logical  conjunction. 
Moreover,  in  any  possible  world  there  always  exists  a  most  specific  known  sentence  (i.e.,  the  conjunction  of 
all  sentences,  whether  objective  or  not,  that  are  known  to  be  true).  Similar  generalizations  will  be  invoked 
in  the  rest  of  this  paper  involving,  in  each  case,  collections  of  subsets  of  the  universe  that  are  closed  under 
set  intersection. 
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n-6.  Special  Subsets  of  the  Epistemic  Universe 
II- 6-1.  Truth  and  Support  Sets 

The  set  of  all  possible  worlds  in  I/(S)  that  map  the  objective  sentence  £  into  the  truth  value  T,  called 
the  truth  set  of  £,  will  be  denoted  by  t(<f ) . 

The  set  of  all  possible  worlds  in  i/(S)  that  map  the  sentence  Kif ,  for  £  in  $(5),  into  the  truth  value  T 
will  be  denoted  by  k(£ ).  This  set  will  be  called  the  support  set  of  £ . 

II-6-2.  Relations  between  Epistemic  and  Support  Sets 

Theorem:  Let  £  be  a  sentence  in  the  frame  of  discernment  <$(S).  Then 

k(£)  =  1J  e(J), 

where  the  union  is  over  sentences  7  in  <h(S )  such  that  7  =>  £ . 

Proof:  By  virtue  of  the  theorem  proved  above,  if  W  is  a  possible  world  and  K£  is  true  in  W ,  then 
there  exists  an  objective  sentence  7,  7  =>  £ ,  such  that  W  belongs  to  e(jr). 

Conversely,  if  7  is  objective  and  7  =>  £  (treatment  of  necessary  implications  as  axioms),  then  K£  is 
true. I 

Theorem:  Let  7  be  a  sentence  in  the  frame  of  discernment  $(5).  Then 

e(/)=k(/)n[  U  £(7)1, 

-  £=*  r 

W)=  U  eW. 

U  MO- 

Proof:  The  first  relation  follows  at  once  from  the  definition  of  epistemic  set  and  the  most  specific 
knowledge  theorem. 

The  second  relation  is  a  direct  consequence  of  the  theorem  proved  immediately  above. 

Finally,  if  K7  is  true,  then  by  the  most  specific  knowledge  theorem,  K£  is  true  for  some  objective 
sentence  £  =>  7.  The  converse  of  this  statement  is  obviously  true.  It  follows,  therefore,  that 

k(7)=  |J  k{£). 

£=>7 

Taking  the  complement  on  both  sides,  the  third  relation  follows  at  oncej 


Ill 

PROBABILITIES  IN  THE  EPISTEMIC  UNIVERSE 


This  section  introduces  probabilities  as  functions  defined  over  certain  special  families  of  subsets  of  the 
epistemic  universe.  These  collections  have  certain  important  algebraic  properties  that  allow  derivation  of 
the  probabilities  of  certain  sets  as  a  function  of  probabilities  of  other  sets  in  the  family.  The  collection 
of  epistemic  sets  introduced  in  the  preceding  section  is  shown  to  have  the  structure  of  a  subset  algebra 
and  probabilities  over  such  a  collection  are  shown  to  possess  the  properties  of  the  basic  functions  of  the 
Dempster- Shafer  theory:  belief  functions  and  basic  probability  assignments. 

To  study  problems  associated  with  the  extension  of  a  probabilities  defined  on  a  subset  algebra  to  another 
subset  algebra  containing  it  (i.e.,  a  richer  subset  collection),  the  conventional  probability  concepts  of  lower 
and  upper  probabilities  are  introduced.  Belief  functions  are  shown  to  be  the  lower  probabilities  induced  in  the 
truth  algebra  (consisting  of  sets  with  similar  ontological  properties)  by  a  probability  defined  in  the  epistemic 
algebra.  These  bounds  are  shown  to  be  attained  and  therefore  to  be  the  best  possible.  Lower  probabilities 
are  further  discussed  in  terms  of  their  more  general  role  as  solutions  to  a  wide  variety  of  evidential  problems. 
These  results  confirm  the  interpretation  of  belief  measurements  advanced  by  Suppes  in  1974  (5|2. 

The  important  concept  of  conditional  probability  is  also  introduced  in  this  section. 

III-l.  Probability  Measures 
II 1-1-1.  Subset  Algebras 

A  subset3  algebra  fi  in  the  set  X  is  a  collection  of  subsets  of  X  that  includes  its  empty  set,  X  itself, 
and  that  is  closed  under  set  complementation,  union,  and  intersection. 

A  subset  algebra  fli  is  said  to  be  a  subalgebra  of  another  subset  algebra  ft?  if  and  only  if  fii  C  f}2  as 
collections  of  subsets  of  X. 

III-1-2.  .Special  Algebras  in  the  Epistemic  Universe 

Four  subset  algebras  in  U(S)  are  of  particular  interest: 

(1)  The  trivial  subset  algebra  of  1/(5),  consisting  solely  of  1/(5)  and  its  empty  set. 

(2)  The  subset  algebra  p(//(5))  4,  identical  to  the  power  set  of  Z/(5),  called  the  possible 
worlds  algebra  of  1/(5). 

(3)  The  subset  algebra  fig,  called  the  epistemic  algebra  of  1/(5),  equal  to  the  smallest 
subset  algebra  containing  the  class  of  the  support  sets  k(<f),  where  S  is  in  the  frame 
of  discernment  $(5)  (Note,  that  by  virtue  of  the  relations  between  epistemic  and 
support  sets  proved  ?.bove,  the  nonempty  members  of  fig  are  unions  of  collections 
of  epistemic  sets  e(f),  where  7  is  in  the  frame  of  discernment  <h(5).). 

2  It  is  important  to  note  that  these  results  support  Suppes’  interpretation  of  lower  and  upper  probabilities  as  the  major 
constraints  on  probabilities  over  richer  subset  algebras,  i.e.,  as  opposed  to  the  arbitrary  interval  constraints  of  interval 
probability  theory.  The  resulting  bounds  agree  with  those  derived  in  the  Dempster-Shafer  theory  only  when  the  inducing 
probabilities  are  defined  on  certain  subset  algebras,  e.g.,  the  epistemic  algebra. 

3  For  simplicity,  we  shall  restrict  our  attention  to  finite  sets.  Extension  to  arbitrary  spaces  requires  introduction  of  the 
concept  of  sigma  algebra  (see,  for  example,  Halmos  (10]). 

4  In  general,  the  notation  P(X)  (or  simply  P)  will  be  used  to  denote  the  power  set  of  a  set  X. 


9 


R  us  pint 


Logical  Foundations  of  Evidential  Reasoning 


10 


(4)  The  subset  algebra  fix,  called  the  truth  algebra  of  U(S),  consisting  of  the  class  of 
the  truth  sets  t(<f),  where  £  is  in  the  frame  of  discernment  <&(S). 

III-1-3.  Probability  Functions 

A  probability  defined  on  the  subset  algebra  fl  of  a  set  X  is  a  mapping  P  from  fl  into  the  [0,  l]  interval- 
of  the  real  line,  that  satisfies  the  following  conditions 

(1)  P(0)  =  0, 

(2)  P(X)  =  1, 

(3)  P(wi  Uw2)  +  P{wi  nw2)  =  P(wi)  +  P(w2)>  whenever  wi,w2  are  in  fl. 

The  triple  (X,  fl,  P)  is  called  a  probability  space. 

III-1-4.  Consistent  Probabilities 

Let  Pi  and  P2  be  probabilities  defined  on  the  subset  algebras  fl x  and  fl2,  respectively,  of  a  set  X.  Then 
Pi  and  P2  are  said  to  be  consistent  if  there  exists  a  probability  function  P,  defined  in  the  smallest  subset 
algebra  fl  that  includes  both  fl^  and  CI2,  such  that 

Pl„l  =  Jpi(w).  if  w  is  in  fli; 

'  IPjjo)),  ifaiisinfl2- 


HI-2.  Lower  and  Upper  Probabilities 
III-2-1.  Kernel  Sets  for  a  Subset  Algebra 

Let  fl  be  a  subset  algebra  of  the  set  X.  Then  the  kernel  of  P(X)  in  fl  is  the  mapping 

Kn  :  P(X)  ►-  fl 

that  assigns  to  every  subset  w  of  X  the  largest  member  of  fl  contained  in  w  (the  proof  of  the  existence  of 
such  a  set  is  well  known  and  will  be  omitted  here). 

For  any  subset  uj  in  P,  the  subset  /Cn(cu)  will  be  called  the  kernel  of  w  in  fl. 

III-2-2.  Kernel  of  a  Truth  Set  in  the  Epistemi c  Algebra 

Theorem:  The  kernel  in  fie  of  the  truth  set  t(<f)  in  U(S)  is  the  support  set  k(<f ). 

Proof:  If  Kif  (S  objective)  is  true  in  W  then,  by  virtue  of  (M2),  £  is  true  and  k(<?)  C  t(<f).  Now  let 
7  be  an  objective  sentence  such  that 

e{7)Ct(£). 

Since  the  sentence 

K7A  (  f\  , 

$*>T 

is  true  in  W  if  and  only  if  W  is  in  the  epistemic  set  e(/),  it  follows  that 
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But  then,  by  virtue  of  the  axiom  (M4),  it  follows  that 

k(k7a  ^  /\  -.K^j  =>K<f  . 


S*T 


Distributing  the  epistemic  operator  K  in  the  left-hand-side  by  application  of  the  axioms  (M3),  (M5), 
and  (M6),  it  follows  that 

K/A  (  f\  -JZg)  , 

\$=>r  ' 

$*r 

or  that 

e(7)Ck(f). 

Since  each  epistemic  subset  that  is  a  subset  of  t(<f)  is  also  a  subset  of  k(£),  and  since  any  member  of  the 
epistemic  algebra  is  a  union  of  (disjoint)  epistemic  sets,  it  follows  that  k(£)  is  the  largest  member  of  the 
epistemic  algebra  that  is  a  subset  of  t(£).I 

III-2-3.  Lower  Probabilities 

Given  a  probability  function  P  defined  on  the  subset  algebra  Cl  of  a  set  X,  the  function 

P.  :  P(X)  [0, 1)  :  w  >->  P(ATnH) 


is  called  the  lower  probability  induced  by  P  in  P(X). 

III-2-4.  Upper  Probabilities 

Given  a  probability  P  defined  on  the  subset  algebra  £1  of  the  set  X,  the  function 


P*  :  P(X)  H.[0,l]:ui-fl- P.(w) 

is  called  the  upper  probability  induced  by  P  in  P  (X) . 

The  notion  of  upper  probability  is  related  to  the  concept  of  a  cover  set  through  a  relationship  that  is 
the  dual  of  that  between  lower  probabilities  and  kernel  sets. 

Let  G  be  a  subset  algebra  of  the  set  X.  The  cover  of  P(x)  in  0  is  the  mapping 

C  :  P(X)  i  ►  Cl 

that  assigns  to  every  subset  w  of  X  the  smallest  member  of  £1  that  contains  u>.  The  subset  C(u>)  is  called  the 
cover  of  uj  in  fl. 

The  proof  of  the  existence  of  a  cover  and  the  proof  that 

p»=p(cm) 

are  well  known. 

III-2-5.  Relations  Between  Probabilities  and  Lower  Probabilities 

Let  P],  and  Pj  be  two  consistent  probabilities  defined  on  the  subset  algebras  Cli  and  CI2,  respectively,  of 
a  set  X.  Further,  let  Hj  C  fl2.  Also,  let  Kp1  and  Pi*  be  the  kernel  of  P(X)  in  Cli  and  the  lower  probability 
induced  by  Pi  respectively.  Then,  since  /Cn,(<u)  C  w  for  any  w  in  P(X)  (hence,  for  any  oj  in  £12),  it  is 

Pi*H  -  Pi(ATn»)  <  PiH  =  PsM  • 
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111-2-6.  Lower  Probabilities  as  Best  Bounds 

The  following  results  show  that  the  bounds  provided  by  the  relations  between  lower  probabilities  and 
consistent  probabilities  cannot  be  improved. 

Theorem:  Let  P  be  a  probability  defined  on  the  subset  algebra  f2  of  the  universe  U(S). 

^  /V 

If  T  =  {wi,U2,...|Un}  is  a  finite  collection  of  subsets  ofll(S),  then  there  exists  a  probability  P  in  Cl, 
the  smallest  subset  algebra  containing  both  fl  and  T,  such  that 


PM  =  p.M  , 

PM>P.W,  i  =  2,...,n, 
P(ai)  >  P(o>)  ,  for  all  w  in  fl . 

Proof:  Let  flj  be  the  smallest  subset  algebra  containing  ui i  and  fl. 
Define  the  subsets  k  and  v  of  U{S)  as  follows: 

k  =  lCn(wi) , 
v  —  (Mi  Die, 

and  define  a  set  function  Pi  over  the  following  members  of  0 1  as  follows: 


Pi(w)  =  0  ,  if  oj  C  v  , 

Pi(w)  =  P(o>  fl  k)  ,  if  w  C  /c , 

Pi(w)  =  maxP(o) ,  if  w  Huj  =  0  , 

A(w) 

where,  in  the  last  line,  the  maximum  is  defined  over  the  collection  of  sets 

A  (w)  =  {n  in  fl  :  a  n  /c  =  0 ;  aflul  =  wn  oq}  • 

The  function  Pi  is  then  defined  over  other  subsets  in  fli  by  additivity  (note  that  the  above  equations  define 
Pi  separately  over  the  sets  k,  v,  and  wT)- 
Then,  clearly,  Pi(0)  =  0,  while 

Pi(i/(S))  =  P(k)  +  max  P(a)  =  P(/c)  +  P(/c)  =  1 . 

A(u) 


Note  also  that  Pi  is  additive  over  subsets  of  k,  in  fix ,  as  these  are  also  in  f2,  and  Pi  =  P  for  such 
subsets.  Further,  Pi  is  additive  over  subsets  of  v  in  fli  since  it  is  equal  to  zero  for  all  such  subsets. 

If  now  xi  and  X2  are  disjoint  members  of  fli,  both  fully  contained  in  ur[,  then 


Pi(xi)  +  Pi(x2)=  max  p(cr)  +  max  P(cr)  . 

A(xi)  A(x3) 


(HI.1) 


Assume  that  the  maximum  values  on  the  right-hand  side  of  the  above  equation  are  attained  for  cr i  and  oq, 
respectively,  both  nonintersecting  with  n. 

Then  it  must  be  <Ti  n  o-z  —  0.  Otherwise,  since 


ox  n  <72  n  uq  =  xi  n  X2  n  =  0 , 
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it  must  be 

O'!  fl  £72  n  U  =  O'!  fl  £72  7^  0 . 

However,  since  both  £7j  and  £72  are  in  n,  then  £7i  fi£72,  a  subset  of  v  and  therefore  of  £Vi,  is  also  in  A.  Then, 
by  the  definition  of  kernel,  it  must  be 

£7l  n  £72  C  K  , 

contradicting  the  assumptions  made  about  both  ctj  and  <r 2. 

Returning  now  to  Equation  III.  1,  it  follows  that 

Pl(Xl)  +  Pl(X2)=P(ai)+P(£72) 

=  P(£7X  U£72) 

<  max  P(£7) 

A(xiUxa) 

=  P(*1  UX2) . 

Since,  on  the  other  hand,  it  is  obvious  that 

max  PM  <  max  P(ct)  +  max  PlV)  , 

A(xiUxa)  A(xi)  A(xi) 

then  combination  of  the  inequalities  III. 2  and  III.3  yields  the  equation 

Pi(Xi)+Pi(X2)=Pi(xiUX2), 

completing  the  proof  that  the  set  function  Pj  is  a  probability  on  fix. 

Furthermore, 

PiM  =  Pi(a>i  n  k)  +  Pi(v)  =Pi(k)  -  P.(o»i) , 
by  the  definition  of  lower  probability. 

If  now  w  C  k,  then,  by  definition,  Pi(tn)  =  P(w).  Otherwise,  if  w  is  in  fl,  w  %.  k,  then 

Pi(w)  =  Pi (w  n  wT)  +  Pi(n>  n  v)  +  Pi(o)  n  k)  >  P(w  n  *)  +P(un»c)  =  P(a>) . 

It  is  also  clear  from  this  relation  that 

Pi.(w)  >P.(«),  for  all  w  in  P (U [$)). 

If  the  above  probability  extension  process  is  repeated  inductively  for  i  =  2,  3, . . . ,  n  replacing  P  by  P;-i 
and  letting  fl,-  be  the  smallest  subset  algebra  containing  both  fl,--x  and  w then  Pn  s  P  is  a  probability 
defined  on  fl,  the  smallest  subset  algebra  containing  both  fl  and  T.  Further,  P(a»x)  =  P*(wx).| 

Corollary:  Let  P,  fl,  fl,  and  T  be  defined  as  before.  Then  there  exists  a  probability  P'  such  that 

P'(wx)  -  a, 

P7^)  ^  P«  (w) ,  for  all  w  in  fl , 

where  a  is  an  arbitrary  value  between  P.(aix)  and  1  —  P.(aJT). 

Proof:  Through  the  same  construction  process  used  in  the  preceding  theorem,  it  is  possible  to  extend 
the  probability  function  P  to  a  probability  P  defined  over  fl  such  that 

P(tJT)  =  P.(  wl)  • 

The  corollary  follows  immediately  by  consideration  of  convex  combinations  of  the  probability  functions 
P  and  P,  both  defined  on  the  subset  algebra  fl.I 


(III.2) 


(III.  3) 
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III-2-7.  Conditional  Probabilities 

Let  P  be  a  probability  defined  on  the  subset  algebra  fi  of  the  set  X.  Let  o  be  an  arbitrary  subset  of  X 
such  that  P(u)  >  0.  The  function 


P(w/o)  = 


P(u>n<r) 


is  called  the  conditional  probability  of  P  with  respect  to  o. 


III-3.  Probabilities  on  the  Epistemic  Algebra 
III-3-1.  Basic  Probability  Assignments 

Let  P  be  a  probability  function  defined  on  the  epistemic  algebra  fig  of  the  universe  Zl(S).  Then  P 
is  said  to  be  a  basic  probability  assignment  on  U(S).  By  abuse  of  language  we  shall  also  say  that  P  is  a 
probability  defined  on  the  associated  epistemic  space  E(S). 

From  the  definitions  of  probability  on  U(S),  the  subset  algebra  LIe,  and  the  disjointness  of  epistemic 
states,  it  is  clear  that  P(e)  =  1  • 

III-3-2.  Probability  Masses 

The  function  m  :  $(S)  i-* ►  (0,  lj,  defined  by  m(£)  =  P(e(£))  ,  is  called  the  probability  mass  associated 

with  P  in  <f>(S). 

It  is  clear  that  m(<f)  =  1. 

£e<i> 

111-3-3.  Support  and  Plausibility 

Let  S  be  a  function  mapping  objective  sentences  in  the  frame  of  discernment  <3>(S)  to  real  numbers  in 
the  [0,  l]  interval,  defined  by 

S{£)  =  P({)1>  e  U(S)  :  K£  true  in  V})  =  P(k(£))  . 

The  real  function  S  is  said  to  be  the  support  function5  in  3>(S)  associated  with  the  basic  probability 
assignment  P. 

Correspondingly,  the  function  PI  defined  by 

PI :  $(S)  >— ►  [0,  l]  :  <f  i— ►  1  — 

is  said  to  be  the  plausibility  function  in  $(5)  associated  with  the  basic  probability  assignment  P.  Clearly, 

Pl(£)  =  l-P(-k(£)) 

is  the  upper  probability  function  in  P(11(S))  associated  with  P. 

111-3-4.  Relation  between  Supports  and  Probability  Masses 

From  the  definitions  of  support  and  plausibility  functions,  it  follows  at  once  that 

m=  £m(7), 

W)=  E  *»(*■)■ 


5  These  functions  are  called  belief  functions  in  [Shafer,  7].  The  term  support  is  used  throughout  this  work  as  it  expresses 
the  meaning  of  the  function  S  more  adequately. 
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III-3-5.  Supports  as  Lower  Probabilities 

It  was  seen  earlier  that  the  kernel  in  the  subset  algebra  He  of  the  truth  set  t(<f)  is  the  set 

MO  =  U  e(0- 

By  virtue  of  the  relation  between  lower  probabilities  and  probabilities,  it  is  clear  that,  if  P  is  a  probability 
defined  on  the  subset  algebra  He  of  the  universe  1/(5),  then 

s(0  =  y,  =  E  p(e(0)  -  p(mo)  =  p.(t(o)  <  p(t(o)  • 

Supports  are,  therefore,  lower  bounds  for  the  probabilities  of  certain  sets  of  possible  worlds  in  which  a 
given  objective  sentence  is  true.  Consistency  between  probabilities  defined  on  the  epistemic  algebra  He  and 
on  the  truth  algebra  fix  requires  that  probabilities  over  the  latter  and  support  functions  over  the  former 
satisfy  certain  inequality  constraints. 

Similarly,  it  may  be  seen  that  plausibility  functions  are  upper  bounds  for  probabilities  defined  on  the 
truth  set  algebra  fix- 

By  using  the  theorem  proved  above  regarding  the  nature  of  lower  probabilities  as  sharp  bounds  for 
consistent  probabilities,  it  can  be  seen  that  the  bounds  for  P  in  terms  of  the  support  function  S  cannot 
be  improved  (simply  consider  fl  =  Oe  and  T  =  fix  in  the  statement  of  the  theorem  of  section  III-2-6).  It 
follows,  therefore,  that  it  is  possible  to  construct  a  probability  P  that  for  the  truth  set  t(5),  may  attain  any 
value  satisfying 

5(5)  <P(t(£))  <  Pl{£). 

III-3-6.  On  the  Role  of  Lower  Probabilities 

The  results  just  derived  show  the  importance  of  the  concepts  of  lower  and  upper  probabilities  in  evi¬ 
dential  reasoning.  Beyond  the  validation  of  support  and  plausibility  functions  as  bounds  on  the  values  of 
the  probability  of  a  truth  set,  lower  and  upper  probabilities  play  a  central  role  in  most  evidential  reasoning 
problems. 

The  treatment  of  these  problems  follows  a  general  two-step  scheme.  The  first  step  is  the  translation  of 
evidential  observations  into  a  number  of  consistent  probabilities  defined  over  some  epistemic  universe.  The 
second  step  consists  of  the  extension  of  these  probabilities  to  some  subset  algebra  of  interest,  usually  the 
smallest  subset  algebra  containing  those  subset  algebras  identified  in  the  first  step.  This  extension  identifies 
possible  values  of  any  probability  function  defined  over  the  richer  subset  algebra.  The  best  characterization 
of  possible  values,  as  shown  above,  is  provided  by  the  upper  and  lower  probability  functions. 

III-3-7.  Perfect  Probabilistic  Information 

Note  that,  in  conditions  of  perfect  probabilistic  information,  i.e,  5  — *  KS  in  Z/(5),  support  sets  are 
identical  to  the  truth  sets;  moreover,  the  epistemic  universe  is  the  same  as  the  Carnapian  universe.  In  these 
cases,  the  interval  [5(5],  -PZ(<f)]  collapses  to  a  single  point  and,  as  is  well  known,  the  results  provided  by 
the  Dempster-Shafer  theory  are  identical  to  those  obtained  by  the  direct  application  of  probability  theory  to 
probability  functions  defined  over  the  truth  algebra  (which  are  now  known  due  to  the  assumed  characteristics 
of  the  information). 
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III-3-8.  Certain  Support  Functions 

If  a  support  function  S  in  is  associated  with  an  epistemic  probability  P  such  that 


m(f)  =  P(e(f))  =  l, 


then  S  is  said  to  be  a  certain  support  function  focused  on  t .  It  is  clear  that 


if  £  =>  T\ 

otherwise. 


III-3-9.  Mobius  Inversion  Formula 

In  the  ensuing  discussion  there  will  be  several  opportunities  to  use  the  following  theorem  |7,  8],  which 
is  a  special  form  of  a  basic  result  of  combinatorial  theory  (Mobius  inversions),  which  was  studied  in  detail 
by  G.C.  Rota  |18], 

Theorem:  Let  Cl  be  a  finite  subset  algebra  of  a  set  U.  Assume  that  there  exist  real  functions  f  and  g, 
defined  on  f2,  such  that 

g(x )  =  £  f(y) ,  for  all  x  of  Cl . 

!/Cl 

Then  it  is 

/(*)  =  £  (-1)ly_s|ff(y) .  for  all  x  of  Cl, 

I/Ci 

where  |y  —  x|  is  the  number  of  elements  z  of  Cl  such  that  x  C  z  Cy. 

III-3-10.  Shafer  Axioms  and  Relations 

Applying  the  basic  result  on  Mobius  inversions  to  the  epistemic  algebra  I2e,  the  basic  formula  expressing 
probability  masses  in  terms  of  support  functions  [7]  can  be  readily  derived: 

m(£)=  £  (-l)l^?l S(7),  (III.4) 

7=>£ 

where  |<f  —  7\  is  the  number  of  elements  Q  in  $(5)  such  that  £  §  =>■  7. 

By  utilizing  related  results  from  combinatorial  theory,  it  is  possible  to  derive  the  following  inequality, 
which  Shafer  uses  as  an  axiom  for  support  functions: 

5(f!V-vg>  £  (— i)m+1s(  (III.5) 

'C(l, ' 


where  |/|  is  the  cardinality  of  the  index  subset  I, 
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111-3-11.  Evidence  as  Conditional  Probabilities 

If  the  sentence  space  is  rich  enough  to  include  propositions  that  describe  not  only  the  results  of  the  anal¬ 
ysis  of  evidential  observations  and  measurements,  but  the  actual  observations  and  measurements  themselves, 
then  the  probabilistic  representation  of  a  body  of  evidence  may  be  thought  of  as  the  conditionalization  of  an 
epistemic  probability  with  respect  to  a  support  set  k(£).  The  proposition  £  represents  the  actual  observations 
and  measurements  which  are  assumed  known  with  certainty. 

This  interpretation  assumes  that,  through  appropriate  extension  of  the  universe  of  discourse,  it  is  possible 
to  represent  conditioning  with  respect  to  uncertain  evidence  as  classical  conditional  probabilities  with  respect 
to  sets  that  represent  certain  evidence.  The  validity  of  this  assumption  has  been  discussed  by  Kyburg|l9]. 

In  the  rest  of  this  work,  the  simplified  notation  P(  ■/£)  will  be  used  as  shorthand  for  P(  -/k(£)).  In 
addition,  in  the  rest  of  this  paper,  the  Greek  letter  £  will  be  used  to  denote  evidential  bodies  and  their 
associated  sets. 

Tlie  formal  impact  of  evidential  observations  or  measurements  may  be  thought  of,  therefore,  as  the 
replacement  of  an  epistemic  probability  P  by  the  result 

p(70  =  p(-A(0), 

of  its  conditioning  with  respect  to  the  support  set  k(£).  The  result  of  the  integration  of  successive  bodies 
of  evidence  £j,  £2, .. .  results  in  the  computation  (through  knowledge  combination  formulas)  of  the  values  of 
the  probability  functions  P(  ■  /£i),  P(  -  /£x,  £2), . ..  P(  •  /£i,  £2,..  -)- 

II1-3-12.  Semantics  of  Evidential  Reasoning 

The  epistemological  basis  of  evidential  reasoning  lies  in  its  interpretation  of  observations  of  the  real 
world  as  equivalent  to  certain  probabilities  that  are  defined  on  the  epistemic  algebra  12e- 

According  to  this  view,  the  informational  content  of  evidence  permits  more  than  simple  discrimination 
between  possible  and  impossible  states  of  the  world  as  dependent  upon  their  logical  or  physical  consistency 
with  available  observations.  Either  from  past  experience,  which  furnishes  the  rationale  for  objective  estimates, 
or  from  rational  considerations,  resulting  in  a  consistent  belief  system  leading  to  subjective  estimates,  the 
information  provided  by  evidence  allows  qualification  or  quantification  of  the  likelihood  of  certain  propositions 
given  the  observed  facts. 

The  evidential  approach  equates  knowledge  of  the  truth  of  certain  propositions  with  availability  of 
observations  supporting  that  validity.  This  relation  between  the  concepts  of  knowledge  and  confirming 
evidence  is  supported  by  the  etymology  of  words  in  the  epistemological  lore.  The  word  evidence  is  related 
to  the  Latin  verb  vide re,  “to  see”,  itself  cognate  with  the  Greek  idem  (from  the  earlier  Greek  widein), 
and  the  Sanskrit  vid,  “to  know”  [16].  The  term  evident  literally  means  “making  itself  seen”  [17].  Asserting 
that  a  proposition  is  known  can  be  thought  therefore  as  declaring  the  existence  of  supporting  evidence. 
Whenever  such  evidence,  however,  is  uncertain  or  inconclusive,  such  assertion  may  be  qualified  by  means  of  a 
probabilistic  statement.  This  statement  measures  the  extent  by  which  the  observer  relies  in  his  measurements 
and  observations  as  true  grounds  supporting  the  knowledge  of  propositional  truth. 

Unlike  certain  classical  approaches  that  assume  that  experimental  data  or  rational  considerations  always 
enable  relative  quantification  of  the  degree  of  support  accorded  by  evidence  for  every  relevant  proposition, 
the  viewpoint  expressed  here  is  that  evidence,  by  its  very  nature,  provides  information  only  about  the  truth 
of  certain  propositions,  while  failing  to  furnish  any  indication,  either  relative  or  absolute,  about  the  truth  or 
falsity  of  others.  In  this  approach,  valuations  (i.e.,  measures  of  relative  evidential  support)  can  be  regarded 
both  as  assessments  of  the  relative  likelihood  of  certain  statements  as  true  descriptors  of  the  real  world  and 
as  measures  of  the  resolving  power  of  evidential  bodies.  Consequently,  an  assignment  of  a  null  value  to  the 
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probability  of  an  epistemic  set  simply  states  that  the  evidence  does  not  support  the  truth  of  a  proposition, 
rather  than  indicating  explicitly  that  the  proposition  is  false. 

If,  for  example,  a  purely  objective  and  frequentist  interpretation  of  probability  is  considered,  the  value 
of  a  probability  over  an  epistemic  set  measures  how  often,  in  past  experience,  acquisition  of  this  type  of 
evidence  has  resulted  in  knowledge  that  a  proposition  (but  not  any  other  proposition  that  implies  it)  was 
true. 

For  example,  if,  at  the  scene  of  a  crime,  a  lock  of  hair  is  found,  having  a  certain  color  and  other  physical 
properties,  such  evidence  may  indicate  that  the  criminal  is  in  a  class  of  individuals  specified  by  hair  attributes. 
Furthermore,  errors  involved  in  collecting  evidence,  analyzing  it,  or  interpreting  the  analysis  may  introduce 
uncertainties  about  the  nature  of  this  class,  resulting  in  the  specification  of  likelihoods  for  different  classes 
of  suspects.  This  distribution,  however,  should  reflect  the  fact  that  the  original  evidence  failed  to  resolve 
the  identity  of  specific  suspects  —  an  informational  deficiency  that  some  approaches  erroneously  interpret 
as  equal  likelihood.  These  interpretations  of  evidence  assume  incorrectly  that  bodies  of  evidence  are  capable 
of  defining  a  probability  distribution  over  the  universe  of  possible,  objective  worlds;  i.e.,  over  alternative 
states  of  nature  that  are  otherwise  incapable  of  being  discriminated  by  the  informational  content.  In  the 
evidential  interpretation,  such  capability  is  restricted  to  certain  subset  algebras,  i.e.  those  having  as  atoms 
subsets  which  may  be  distinguished  by  the  evidence. 

Finally,  this  interpretation  properly  recognizes  that  evidence  changes  not  the  state  of  the  world  but 
rather  the  state  of  knowledge  about  it.  The  acquisition  of  evidence  should,  therefore,  lead  to  changes  in  the 
formal  structures  that  are  used  to  represent  knowledge  states. 


IV 

THE  COMBINATION  OF  KNOWLEDGE 


This  section  is  devoted  to  the  discussion  of  the  problems  associated  with  integrating  the  knowledge  of 
two  distinct,  mutually  trusting  agents. 

Two  important  spaces  are  introduced:  the  first  is  simply  the  Cartesian  product  of  the  two  universes 
being  combined,  representing  possible  states  of  knowledge  that  each  agent  may  possess  solely  by  virtue  of 
the  evidence  available  to  him;  the  second,  called  the  logical  product  universe,  represents  the  possible  results 
of  this  combination. 

Epistemic  algebras  and  probabilities  defined  on  them  are  then  related  to  arrive  at  the  additive  com¬ 
bination  theorem,  a  general  result  that  serves  as  a  basis  for  deriving  a  variety  of  evidence  combination 
formulas. 

IV-1.  Multiple  Epistemic  Agents 
IV-1-1.  Multiple  Worlds 

Throughout  the  rest  of  this  work  we  shall  be  considering  more  than  one  universe  li(S),  each  satisfying 

the  axioms  of  epistemic  logic.  Each  universe  may  be  based  on  different  symbol  alphabets  Ai,  A2, _  In 

general,  therefore,  different  universes  will  contain  possible  worlds  that  map  different  sentence  spaces  into  the 
set  of  truth  values  {T,F}. 

Different  universes  and  their  associated  structures  (i.e.,  epistemic  spaces,  most  specific  mappings,  frames 
of  discernment,  etc.)  will  be  differentiated  by  the  use  of  numeric  subscripts,  e.g.  Zl(Si),  and  $(S2)- 

TV-1-2.  Multiple  Agents 

Subscripts  will  also  be  used,  whenever  necessary,  to  differentiate  unary  epistemic  operators,  e.g.  Kj,  K-2- 

Different  operators  will  usually  be  interpreted  as  representing  the  knowledge  of  different,  rational,  and 
mutually  trusting  agents  that  are  combining  their  knowledge  to  arrive  at  a  consensual  agreement  (usually 
represented  by  an  unsubscripted  epistemic  operator  K). 

Throughout  this  section  we  consider  the  problems  that  arise  when  of  the  knowledge  of  two  mutually 
trusting  rational  agents  is  combined. 

IV-2.  Product  Spaces  and  Universes 
IV-2-1.  Product  of  Sentence  Spaces 

Let  Si  and  S2  be  two  sentence  spaces.  The  logical  product  S 1  ®  S2  of  Si  and  S2  (or  product,  for  short) 
is  the  space  of  all  sentences  defined  by  the  axioms: 

(PSl)  If  £  is  an  objective  sentence  in  Si,  for  i  =  1  or  2,  then  £  is  a  sentence  in  the  product 
space  Si  ®  52. 

(PS2)  Axioms  (S2)  -  (S5),  given  in  section  II- 1-2,  defining  well-formed  epistemic  sen¬ 
tences. 
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IV-2-2.  Possible  Worlds  in  Product  Space 

A  possible  world  in  the  product  sentence  space  Si  ®  S2  is  a  mapping  from  that  space  into  the  truth  set 
{T,F}  that  satisfies  the  following  axioms: 

(PUl)  The  possible  world  ~W  satisfies  the  axiom  schemata  (M). 

(PIJ2)  If  £  is  a  sentence  in  Si  ®  S2,  then  the  sentence  K£  is  true  in  the  possible  world  W 
if  and  only  if  there  exist  sentences  Si  and  £2  in  Si  and  S2,  respectively,  such  that 
K  £,-  is  true  in  W  and  Si  A  S2  =>  £  ■ 

IV-2-3.  Remarks 

It  is  important  to  note  that  the  notion  of  possible  worlds  in  a  product  space  is  not  only  well  defined, 
but  also  captures  the  notion  of  combination  of  the  knowledge  of  two  evidential  bodies. 

Axiom  (PU2)  restricts  the  scope  of  possible  worlds  by  requiring  that  propositions  known  to  be  true  in 
a  possible  world  in  the  product  space  be  either  sentences  in  the  spaces  being  combined  that  are  known  to 
be  true  in  that  world;  or  logical  consequences  (i.e.,  necessary  or  semantic  entailments)  of  the  truth  of  those 
propositions. 

The  correctness  of  this  type  of  axiom  was  noted  above  in  section  II-3-2  when  discussing  the  semantic 
aspects  of  logical  implication. 

IV-2-4.  Product  of  Universes 

The  set  of  all  possible  worlds  over  the  product  sentence  Si  ®  S2  that  satisfy  the  axiom  schemata  (PU) 
will  be  called  the  logical  product  universe  over  Si  <8>  S2  (or  product  universe,  for  short),  denoted  I/g,(Si  ®  S2). 

IV-2-5.  Product  of  Frames  of  Discernment 

The  product  of  two  frames  of  discernment  <3>(Si)  and  $(S2)  is  the  frame  of  discernment  $(Si  ®  S2), 
equal  to  the  quotient  set  of  the  objective  sentences  of  Si  ®  S2  by  the  equivalence  relation  O-  in  U®(S 1  ®  S2). 

IV-2-6.  Remarks 

Note  that,  by  construction,  the  symbols  in  the  product  space  Si  ®  S2  are  those  that  represent  sentences 
that  are  in  either  Si  in  S2  with  the  unary  operators  Ki  and  K2  replaced  by  K. 

Furthermore,  also  by  construction,  the  truth  of  objective  sentences  in  a  possible  world  ~W  in  if®  (Si  ®  S2) 
is  determined  by  the  truth  of  sentences  that  are  either  in  3>(Si)  or  in  $(S2).  If  S  is  a  sentence  that  does  not 
include  the  epistemic  operator  K,  then  S  is  true  in  W  if  and  only  there  exist  sentences  Si  in  Si  and  S2  in 
S2  such  that  Si  A  S2  =>  S. 

IV-2-7.  Cartesian  Projection 

The  mapping  II,  defined  by  the  expression 

n :  u9{s  1  ®  s2)  1-.  tf(so  x  a(s3)  =  iv  ~  (w1(  w2) , 

where  TV,'  (i  =  1,  2)  is  the  unique  possible  world  in  I/(S,  )  defined  by  the  conditions 

(1)  The  sentence  £  in  $(S,-)  is  true  in  IV*  if  and  only  if  S  is  true  in  W , 

(2)  The  sentence  K^S,  with  S  in  $(S,),  is  true  in  IV,  if  and  only  if  the  sentence  K£  is 
true  in  "W , 

is  called  the  Cartesian  projection  of  U®  (Si  ®  S2). 
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Proposition:  The  Cartesian  projection  of  U®  (Si  ®  S2)  is  an  injective  mapping. 

Proof:  As  noted  above,  the  truth  of  objective  sentences  in  W  is  determined  by  the  truth  of  objective 
sentences  in  £j  or  in  £2. 

Furthermore,  if  a  sentence  is  of  the  form  K£,  where  £  is  objective,  its  truth  is  also  determined  (because 
of  the  axiom  (PU2))  by  the  truth  of  sentences  of  the  form  K7,  where  7  is  in  either  3>(Si)  or  $(52)- 

Finally,  the  truth  of  every  other  sentence  in  Si  ®  S2  is  determined  by  the  truth  of  sentences  in  the  above 
classes. 

Therefore,  if  two  possible  worlds  in  11®  (Si  ®  S2)  assign  the  same  truth  values  to  sentences  in  Sj  and  S2, 
then  they  assign  the  same  truth  values  to  all  sentences;  in  other  words,  they  are  identical.! 

PV-S.  Epistemic  Sets  in  the  Product  Universe 
IV-3-1.  Marginal  Support  Sets 

The  marginal  support  set  in  ll®(5i  ®  S2)  for  the  sentence  in  $(,?,•),  denoted  by  k,-(<f,-),  is  the  set  of 
all  possible  worlds  Vi)  in  ll®(5i  ®  S2)  such  that  K<?,-  is  true  in  IV ,  (i  =  1,  2). 

IV-3-2.  Marginal  Epistemic  Sets 

The  marginal  epistemic  set  in  11®(5  1  ®  S 2)  for  the  sentence  <ft-  in  <J>(S,),  (i  —  1,  2),  denoted  by  e,-((f,-); 
is  the  set  of  all  possible  worlds  W  in  11®  (5 1  ®  $2)  such  that  is  the  most  specific  sentence  in  d>(5,-)  that  is 
known  true  in  W .  The  existence  of  this  sentence  is  proved  in  the  same  manner  as  before  (section  II- 5 ) . 

It  is  clear  from  the  definitions  and  the  basic  theorem  relating  epistemic  and  support  sets  that 

£.-(£)  =  U  M?),  i  =  1>2> 

T=>£ 

where  the  union  in  the  above  formula  is  over  marginal  epistemic  sets  e,(J)  such  that  7  is  in  $(Si)  and 

7  =>  £ . 

Note  also  that,  since  there  is  always  a  sentence  <f,-  in  <I>(S;),  t  =  1,  2,  such  that  K is  true  (e.g., 
£i  =  then  every  possible  world  in  ll®(Si  ®  S2)  belongs  to  some  marginal  epistemic  set  e,(<£) ,  i  =  1,  2. 

IV-3-3.  The  Basic  Combination  Theorem 

Lemma  :  Let  £  be  a  sentence  in  $(S  1  ®  52)-  If  e(<f )  is  nonvoid,  then  there  exist  sentences  £1  and  £2 
in  $(S  1)  and  <£($2)1  respectively,  such  that  £  -«■  £\  A  £2. 

Proof:  Let  W  be  in  the  nonvoid  epistemic  set  e(£).  Since  K<£  is  true  in  W,  then,  by  virtue  of  (PU2) 
there  exist  sentences  £j  and  £2  in  Si  and  S2,  respectively,  such  that  £j  A  £2  =>  £  and  K(<fi  A  £2)  is  true  in 

W. 

But  then,  by  the  definition  of  epistemic  set,  it  must  be  £  =>  £1  A  £2  and,  since  also  £1  A  £2  =>  ,  it 

follows  that  £j  A  £2  O  £  .1 

Corollary:  There  exists  a  mapping 

T  :  $(5!  ®  S2)  ~  P(*(Si)  X  $(S2)) 

that  assigns  to  every  sentence  £  in  <f>(Si  ®  S2)  a  subset  0/ sentence  pairs  (<fi,  £2)  with  £j  in  <5(5,-),  i  =  1,  2, 
such  that  £1  A  £2  £  in  11®  (5i  ®  ,!>2)- 

Further,  if  £  £',  then 

r(£)nr(<f')  =  0. 

Proof:  The  existence  of  the  mapping  T  for  sentences  £  such  that  e(£)  is  nonvoid  follows  directly  from 
the  lemma.  The  definition  of  T  is  completed  by  defining  r(if)  =  0  whenever  e(<f)  =  0. 
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If  r(<f)  fi  T(£')  7^  0,  then  there  exist,  by  virtue  of  the  lemma,  a  possible  world  TV  in  L®(£i  ®  £2)  and 
sentences  (fj  and  £ 2  in  S 1  and  £2,  respectively,  such  that  K(<fi  A  £ 2 )  is  true  in  TV  and 


£<*  £1  A  £2  <*■£' . 


It  is  thus  clear  that  T(<f )  =  r(£').l 

The  mapping  T(£)  will  be  called  the  compatibility  relation  of  $(£1  ®  £2). 

Theorem  (Basic  Combination  Theorem):  Let  £  be  an  objective  sentence  in  the  product  frame  of 
discernment  $(£1  ®  52).  Then 

«(£)  =  U  [M^nM^)].  (IV.1) 

r(f) 

where  the  union  is  over  all  pairs  (£ j ,  £ 2 )  in  3>(£j)  X  ${£2)  such  that  (£x,  £2 )  is  in  J?(£). 

Proof:  If  e(£)  is  empty,  then  T(£)  is  empty  and  the  theorem  follows  at  once. 

Otherwise,  let  TV  be  in  e(<f).  Then  since  every  possible  world  is  in  some  marginal  epistemic  set  e,- (£,•), 
i  =  1,  2,  it  follows  that  there  exist  sentences  £j,  £2  in  $(£1)  and  $(52),  respectively,  such  that  IV  is  in 
ei(fi)  ne2(£2). 

Now,  by  virtue  of  the  lemma,  there  exist  sentences  7\  and  72  in  Si  and  S2>  respectively,  such  that 
£  7\  A  72-  Further,  both  K<fi  and  TL£2  are  true  in  If. 

By  the  definition  of  marginal  epistemic  set  it  follows  that  £{  =>  7i,  i  =  1,  2,  and  therefore  £1  A  £2  =>■ 
7\  A  72  O-  £.  Since  TV,  on  the  other  hand,  is  in  e(£),  and  since  K(£i  A  £2)  is  true  in  TV,  it  follows  that 
£  =>  £\  A  £2  and  therefore 

£1  A  £2  £  . 

Now  let  TV  be  in  ei(£i)  O  e2(£2),  such  that  £x  and  £2  are  in  £1  and  £21  respectively,  and  £  -«-  £1  A  £2. 
Then,  since  K£  is  true  in  TV,  it  follows  that  K./  is  true  whenever  £=>•/. 

If,  on  the  other  hand,  KF  is  true  in  TV,  then  by  virtue  of  the  axiom  (PU2),  there  exist  sentences  7\ 
and  72  in  £1  and  £2,  respectively,  such  that  K7i  and  K £2  are  both  true  in  TV  and  7\  A  72  =>  7.  However, 
since  TV  is  in  ei(£i)  and  in  e2 (£2)1  it  follows  that 

£1  =>  7\  and  £2  =>  72  - 

Therefore,  it  is  £  £\  A  £2  =>  7\  A  72  =>■  7M 

IV-4.  Marginal  and  Product  Epistemic  Algebras 

IV-4-1.  Marginal  Epistemic  Algebras 

The  smallest  algebra  in  11®(£i®£2)  that  contains  the  marginal  epistemic  sets  e;(£)  for  £  in  $>(£<),  for  i  — 
1  or  2,  will  be  called  the  marginal  epistemic  algebra  for  $(£,•),  denoted  by  nE(li®  J. 

IV-4-2.  Product  Epistemic  Algebra  in  the  Product  Universe 

The  smallest  subset  algebra  of  U®(Si  ®  £2)  that  contains  the  marginal  epistemic  algebras  an<^ 

flE(i/®)  is  called  the  product  epistemic  algebra  of  i/®(£i  ®  £2),  denoted  by  He (If®). 

Clearly,  this  subset  algebra  contains  all  the  sets  of  the  form  ej(£i)  ne2(£2),  and  therefore,  by  virtue  of 
the  basic  combination  theorem,  all  epistemic  sets  e(£). 

Note,  however,  that  the  product  epistemic  algebra  He^®)  contains,  in  general,  the  epistemic  algebra 
of  11®  (£  1  ®  £2 )•  The  atoms  of  the  latter,  as  shown  by  the  basic  combination  theorem,  are  unions  of 
atoms  of  the  former. 
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IV-4-3.  Special  Subset  Algebras  in  U(Si)  X  Z/(£2) 

Let  ei(£i)  and  e2(£2)  denote  the  subsets  of  lf(£i)  x  U(S2)  defined  by  the  expressions 

Zi(ti)  =  e1(S1)xU(S2), 

^2(^2)  =  U(Si)  x  ^2(^2}  1 

for  £1  in  $(£1)  and  £2  in  <F(£2). 

The  marginal  epistemic  algebras  flg(L x )  and  flg(Lx )  are  the  smallest  subset  algebras  of  U(S\)  x  U(S2) 
that  contain  the  collections  of  subsets 


1):  £1  is  in  $(£1)},  (e2(£2)  :  £2  is  in  <1>(£2)}  1 


respectively. 

The  product  epistemic  algebra  CIe(Ux)  is  the  smallest  subset  algebra  of  U(S  1)  xZ/(£2]  that  contains  the 
marginal  epistemic  algebras  fig  and  fig.  Once  again,  we  must  note  that  this  algebra  contains,  in  general, 
the  algebra  generated  by  the  projections  by  the  mapping  II  of  the  epistemic  sets  e(£)  in  Zf®(£i  ®  £2). 

IV-4-4.  Epistemic  Sets  in  the  Cartesian  Product  U(Si)  X  L(£2) 

By  abuse  of  language,  the  term  marginal  epistemic  sets  (in  U(S  1)  X  Z/(£2))  will  be  used  to  describe  sets 
of  the  type  ei(£i)  and  e2(£2),  with  £1  in  $(£1)  and  £2  in  $(£2).  The  corresponding  support  sets  will  be 
similarly  referred  to  as  marginal  support  sets. 

The  term  product  epistemic  sets  (in  i/(£i)  xi/(£2))  will  be  used  to  describe  those  subsets  of  U  (£1)  xf/(£2) 
that  are  in  the  subset  algebra  generated  by  sets  of  the  form 

Ci  (£1)  fl  e2(£2)  =  ej(£i )  x  e2(£2),  £1  in  <3>(£i),  £2  in  <F(£2). 


IV-5.  Probabilities  in  the  Product  Universe 

IV-5-1.  Relations  between  Compatibility  Mappings  and  Cartesian  Projections 

Theorem:  Let  £  be  an  objective  sentence  in  £  such  that  the  epistemic  set  e(£)  is  nonvoid  in  (£1®  £2). 
If  "W  is  a  possible  world  in  U®  (£1  ®  £2),  then  there  exists  a  pair  (£1,  £2)  in  T(£)  such  that  the  Cartesian 
projection  ( Wi ,  of  W  is  in  the  subset  e^f*)  x  e2(£2)  of  Z/(£i)  X  L(£2) 

farther,  if  (Wi ,  is  in  ex  (£x)  x  e2(£2),  (£x ,  £2)  in  II (£ ),  then  there  exists  a  unique  world  W  in 
U®($i  ®  £2)  such  that  11(741)  =  (^,^2). 

Proof:  By  the  definition  of  Cartesian  projection,  a  sentence  K,£,  with  £  in  $(£,-)  i  =  1,  2,  is  true  in 
the  world  %  in  Zi(£;)  if  and  only  if  K£  is  true  in  W- 

Therefore  II  maps  worlds  in  £;(£,-)  into  pairs  of  worlds  in  e, -(£,-),  t  =  1,  2. 

Since  every  world  W  in  e(£)  is  a  set  intersection  of  the  form  ex  (£x)  D  e2(£2)  for  some  pair  (£1,  £2)  in 
T(£),  it  follows  at  once  that  II  maps  W  into  the  Cartesian  product 

ei(£i)  X  e(£2)  =  ex(£a)  n  e2(£2) . 

Conversely,  if  (Wi, ")V2)  is  in  ex(£x)  x  e2(£2),  (£i,£2)  in  T(£),  then,  as  proved  above,  there  exists  a 
unique  possible  world  W  in  i/®(£i  ®  £2),  mapped  by  II  into  (TVi,  W2).  Further,  "W  is  in  e(£x  A  £2)  =  e(£).| 
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Corollary:  The  mapping  IT  defines  a  one-to-one  transformation  between  U®(S i  ®  $2)  a  subset  11® 

of  the  Cartesian  product  U(S  1)  X  U(S2)  such  that 

(i)  The  images  of  the  marginal  epistemic  algebras  ofU®(Si  ®  S2)  by  II  are 

subalgebras  of  the  marginal  epistemic  algebras  n'E(I/x)  of  U(Si)  X  ( S2 ) - 

(ii)  The  image  of  the  epistemic  algebra  fl e(^®)  of  U®(Si  ®  S2)  ]S  a  subaJgebra  of  the 
product  epistemic  algebra  Oe(Z/x )  of  U (Si)  X  U(S2). 

(iii)  The  image  II®  of  Z/®  ®  S2)  by  II  is  the  union  of  sets  of  the  type  ei  (£1)  X  e2(f2) 

with  fi  and  C2  in  $(5 1)  and  $(52),  respectively. 

Proof:  The  first  and  second  parts  of  the  corollary  follow  immediately  from  the  theorem. 

To  prove  the  third  part,  it  is  sufficient  to  observe  that,  if  II®  intersects  a  set  of  the  type  ei  (<fi)  x  e2(<f2), 
then  it  includes  such  a  set.I 

IV-5-2.  Probabilities  Induced  in  the  Product  Universe 

Let  P  be  a  probability  defined  on  the  product  epistemic  algebra  flE(ZZx)  of  Z/(Si)  x  Z/(S2).  Then  the 
probability  function  P  defined  on  the  product  epistemic  algebra  He(Z/®)  by  the  expression 

p(w)  =  p(n(w)/n®) 

will  be  called  the  epistemic  probability  induced  by  II  and  P  in  Z/®(S  1  ®  S2). 

The  proof  that  P  is  a  probability  is  straightforward  and  therefore  it  will  be  omitted  here. 

IV-5-3.  The  Nature  of  Probabilities  in  Product  Universes 

The  injective  nature  of  the  Cartesian  projection  II  indicates  that  Z/®(Si  ®  S2)  may  be  regarded  as 
a  set  embedded  in  the  Cartesian  product  U(Si)  x  U(S2).  The  epistemic  probability  is  thus  the  result  of 
constraining  probabilistic  knowledge  in  U{Si)  x  U(S2)  to  those  worlds  that  are  possible  after  the  knowledge 
of  two  agents  has  been  combined. 

The  foregoing  developments  have  resulted  in  the  introduction  of  two  probability  functions,  P  and  P, 
in  universes  that,  respectively,  represent  possible  states  of  knowledge  of  two  rational  agents,  on  one  hand, 
and  the  results  of  the  combining  that  knowledge,  on  the  other.  Through  the  Cartesian  projection  mapping 
H,  these  probabilities  can  be  considered  as  defined  on  the  same  Cartesian  space  Z/(Si)  x  U(S2),  with  the 
function  P  being  the  conditional  probability  of  P  with  respect  to  the  subset  31®  of  Z/(Si)  x  U(S2). 

The  unconditioned  probability  P  represents  possible  states  of  knowledge  of  two  agents,  Ai  and  A2,  prior 
to  their  combination.  In  such  a  state,  it  is  conceivable  for  one  of  the  agents,  for  example  Ai,  to  regard  as 
possible  consideration  by  v42  of  certain  worlds  that  are  logically  inconsistent  with  the  evidence  available  to 
Ai.  The  probability  P(ei(£i)  X  e2(f2))  is  a  measure  of  the  joint  degree  of  support  given  by  A\  and  by  A2 
to  the  possibility  that  the  evidence  known  to  Ai  supports  £j  and  that  the  evidence  known  to  A2  supports 
the  truth  of  f2.  It  is  explicitly  assumed  that  neither  Ai  nor  A2  know  the  evidence  available  to  the  other.  It 
is  then  possible  for  one  of  them  to  consider  that  a  proposition  may  be  true  while  the  other  (with  different 
evidence  at  his  disposal)  may  know  such  proposition  to  be  false. 

The  probability  P,  on  the  other  hand,  represents  the  consensus  of  both  agents  after  consideration  of 
the  evidence  available  to  both.  Unlike  P,  which  represents  states  of  separate  knowledge,  the  probability  P 
represents  the  result  of  their  integration.  Clearly,  logical  of  physical  impossibilities,  represented  by  pairs 
(fi.fa)  in  the  complement  H®,  cannot  be  assigned  positive  probabilities.  The  remaining  possibilities, 
represented  by  the  set  intersections  ei(fi)  ne2(f2),  are  given  probabilistic  weights  that  are  consistent  with 
the  support  values  assigned  prior  to  evidential  combination  and  with  the  known  relations  between  ei(f]) 
and  e2(if2). 
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IV-5-4.  Relations  Between  Inducing  and  Induced  Probabilities 

Proposition:  Let  P  be  the  epistemic  probability  induced  by  P  and  II  in  U®  (Si  ®  S2).  .Further,  assume 
that  P{II®)  is  positive. 

If  (o  in  the  subset  algebra  Q e(Ux)>  js  such  that  ui  =  ei(£i)  X  e2(£2)  For  some  sentences  Si  in  $(Si)  and 
£2  in  4>(S2),  then 

p(w)  =  (  «P(n(w)),  ifoj  C  II®; 

1  \  0,  otherwise. 

where  k  =  P(II®)_1  is  a  constant  independent  of  w. 

Proof:  If 

w  =  ei(fi)  x  e2(f2)  £  n®  , 


for  some  £1  in  Si  and  f2  in  S2,  then  w  n  II®  =  w  and,  clearly, 


P(w)  --  nP(w) . 


Otherwise  u>  fl  II®  =  0  and 

P(w)  =  P(w/n®)  =0.1 


IV-5-5.  Knowledge  Combination  as  Conditionalization 

It  has  been  remarked  in  Section  III-3-11  that  epistemic  probabilities  may  be  interpreted  as  the  result  of 
conditioning  an  epistemic  probability  P  with  respect  to  a  support  set  k(£)  that  represents  possible  worlds 
consistent  with  evidential  observations.  Furthermore,  combination  of  two  evidential  bodies  may  be  regarded 
as  the  derivation  of  a  conditional  epistemic  probability  P(  •  /£i,  £2)  from  the  probability  functions  P(  •  /£i) 
and  P(  -/£2). 

Since,  by  virtue  of  the  basic  combination  theorem,  it  is 

e(*)=  U  [MfdnMftO]. 

r(£) 

then  probabilistic  knowledge  combination  can  be  regarded  as  the  derivation  of  the  conditional  probabilities 

P(ei(£i)  ne2(fj)/(i,f2)  , 


that  allow  computation  of 


from  the  conditional  probabilities 


P(e(£)/6.&), 


p(V£i)  =  mi() 


P(/f2)  =  maO- 


Ruspini 


Logical  Foundations  of  Evidential  Reasoning 


26 


IV-6.  Probability  Masses  in  the  Product  Universe 
IV-6-1.  The  Additive  Combination  Theorem 

Theorem  (Additive  Combination  Theorem):  Let  P  be  a  probability  dehned  on  the  product  epistemic 
algebra  of  U®(Si  ®  52),  and  let  m  be  its  associated  probability  mass.  Then,  if  £  is  in  ®  S2)  it 

is 

m(£)  =  J2  P(SiKi)  nea(f2))  ,  (IV.2) 

r(£) 

where  the  sum  is  over  all  pairs  (£1,62)  in  <£(£1)  X  $(  £2)  such  that  (£1,  £2)  is  in  T(£). 

Furthermore,  i/P  is  the  epistemic  probability  induced  by  P  in  U(Si)  X  Z/(S2)  and  if  P(Ilg)  >  0,  then 

m(£)  =  K  ]T)  P(ei(^i)  x  e2 ( £2))  , 
r(f) 

where 

«  =  p(n®)_1 

is  the  only  real  constant  that  makes 

£ 

Proof:  The  first  part  of  the  theorem  follows  at  once  from  the  basic  combination  theorem,  the  additive 
properties  of  a  probability,  and  the  obvious  fact  that  the  sets 

ei  (£1)  ne2(£2),  &i  (£()  n  e2(£2) ,  £1,  £(  e  $(5i),  and  £2,  £2  G  $(S2)  i 

are  disjoint  if  (£lt  £2)  ^  (£{,  £2). 

The  second  part  of  the  theorem  is  also  an  immediate  consequence  of  the  proposition  proved  above,  if  it 
is  noted  that 

k  =  p(  n®)-1, 

and  that 

p(u»(5i®52))  =  X)m(f)  =  P(n®/n«)  =  i  j 

£ 


V 

THE  COMBINATION  OF  INDEPENDENT  EVIDENCE 


This  section  is  devoted  to  the  derivation  of  Dempster’s  rule  of  combination  from  the  bases  provided  by 
the  additive  combination  theorem  and  certain  independence  assumptions.  The  nature  of  these  assumptions 
and  their  meaning  are  discussed  in  terms  of  other  concepts  that  were  introduced  in  previous  sections. 

V-l.  Probabilistic  Independence 
V-l-1.  Independent  Subalgebras 

Let  fli  and  O2  be  subalgebras  of  the  subset  algebra  fi  of  a  set  X.  Let  P  be  a  probability  on  X  with 
subset  algebra  fl.  Then  the  subset  algebras  fli  and  fl2  are  said  to  be  independent  with  respect  to  the 
probability  P  if  and  only  if 

P(wi  nu2)  =  P(wi)P(w2) 

whenever  wj  is  in  fl2  and  w2  is  in  fl2. 

V-l-2.  Independence  Semantics 

Independence  between  two  subset  algebras  with  respect  to  a  probability  is  the  formalization  of  the 
notion  that  values  of  that  probability  function  on  one  of  the  subset  algebras  do  not  depend  (in  a  functional 
sense)  on  the  probability  values  on  the  other.  In  this  case,  the  conditional  probability  P ( -  /cl/j ) ,  defined  on 
fl2  for  any  member  u>1  of  fli  such  that  P(wi)  >  0,  is  the  same  as  the  unconditioned  probability  P  over  fl2. 

If  two  subset  algebras,  fli  and  fl2,  are  independent  with  respect  to  the  probability  P,  then  the  values 
of  P  over  the  smallest  subset  algebra  fl  that  contains  them  will  be  known  once  P  is  specified  separately  over 
fli  and  fl2.  In  addition,  probability  values  over  one  of  those  algebras  may  be  varied  without  affecting  the 
values  over  the  other. 

Sometimes  the  values  of  P  over  fli  and  fl2  are  thought  of  as  being  the  values  of  two  different  probability 
functions  Pi  and  P2,  which  are  then  said  to  be  independent.  This  is  one  of  the  most  frequent  characteriza¬ 
tions  of  statistical  independence,  which  we  do  not  use  here,  as  it  tends  to  obscure  (by  concealing  the  role  of 
a  more  encompassing  probability  function  P),  the  context  under  which  probabilistic  independence  reduces 
to  functional  independence. 

V-l-3.  The  Dempster  Combination  Formula 

Theorem  (Dempster  [6]):  Let  P  be  the  epistemic  probability  induced  in  I/®(Si  ®  S2)  by  a  probability 
P  defined  in  the  product  epistemic  algebra  11e  (ifx)  of  li(Si)  X  I/(S2).  Assume  thatP(lT®)  >  0.  Assume  also 
that  the  marginal  epistemic  algebras  fl^l/x)  and  fi|.(Z/x)  ofU{Si)  X  1/(S2)  are  independent  with  respect  to 

P. 

Let  m  be  the  probability  mass  associated  with  the  probability  P  in  <&(Si  ®  S2),  and  mi,  and  m2  be  the 
probability  masses  associated  with  P  in  the  frames  of  discernment  $(Si)  and  $(.S2),  respectively.  If  £  is  in 
3>(S  1  ®  S2),  then 

m{£)  =  K  ^2  ,  (V.l) 

r(f) 
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where  the  sum  is  over  all  pairs  (£u  £ 2 )  in  3>(Si)  x  <F(S2)  such  that  (£lt  £ 2 )  is  in  r(<f ),  and  where  k  is  the 
only  real  constant  such  that 

e 

Proof:  Let  £\  and  £2  be  such  that  x  62(^2)  £  11®,  and  let  k  =  P(II®)-1.  Then,  by  the 

hypothesis  of  independence,  it  follows  that 

P(ei{fi)  x  e2(f2))  =  P(e,(£,)ne2(f2))  -  P(e1(f1))P(e2(^})  =  mx(£x)  m2 (£2)  . 

The  theorem  follows  at  once  from  this  equation  and  the  additive  combination  theorem .1 
V-l-4.  Femark 

The  above  formula  is  usually  given  for  the  case  where  Si  =  52-  The  form  given  here  allows  combination 
of  knowledge  over  different  frames  of  discernment. 

V-l-5.  Independence  as  Sensor  Independence 

In  most  applications,  the  underlying  probability  P  describes  the  statistical  behavior  of  a  group  of  sensors, 
or  observers  of  a  real  world  system.  Under  these  conditions,  independence  of  the  marginal  epistemic  algebras 
can  be  interpreted  as  the  lack  of  influence  of  errors  made  by  one  sensing  device  on  the  statistical  behavior 
of  the  other.  It  is  important  to  note,  however,  that  the  sensors  (which,  after  all,  are  designed  to  perform 
accordingly)  will  be  affected  by  the  state  of  the  world. 

Finally,  it  is  important  to  note  that  using  the  interpretation  of  epistemic  probability  presented  in  Sections 
III-3-11  and  IV-5-6,  the  assumption  of  independence  of  the  evidential  bodies  is  equivalent  to  the  condition 

P(5i(fi)ne2(£2))  =P(e1(f1))P(e2(f2))J  if  £1  A£2fr<p. 


V-l-6.  Combination  with  Certain  Support  Functions 

Consider  now  the  case  where  the  probability  P  is  such  that 

m2(jr)  =  P(e2(s))  =  1, 

for  some  sentence  /  in  the  frame  of  discernment  4>(S2).  Then,  it  is  clear  that 

P(ei(<fi)  x  e2((f2))  =  P(e:(<fi)  fl  e2(<f2))  =  0, 

if  £3  &  7. 

Furthermore, 

P(ei(£i)  x  e2(/))  =  P(e1(S1)  x  e2{7))  +  V  P(ex(£x)  X  e2(f2))  =  P(ei(£i)  x  U(S2))  =  P(Si(£i))  • 

These  equations  imply  that 

P(Si(fr)  nea(£2))  =  P(Si(<fi))P(M^))  • 


The  marginal  epistemic  algebras  are,  therefore,  always  independent  whenever  one  of  the  corresponding 
marginal  probabilities  is  focused  on  a  single  epistemic  set. 

When  U(S  1)  =  i/(S2)  =  Zi(S),  then  application  of  the  Dempster  combination  formula  yields  the  well 
known  Dempster’s  Rule  of  Conditioning 


sv/n  = 


s[£v^f)-s[->r) 

i-sK) 


$(£//)  =  P(k(fv^)/kRj) 


p*(k(S  v-./)nt(/J) 
P*(t(f)) 


Note  also  that 


VI 

SIMPLE  FORMS  OF  DEPENDENT  EVIDENCE 


This  section  presents  the  results  of  applying  the  additive  combination  theorem  to  the  combination  of 
evidential  bodies  that  depend  on  each  other  in  relatively  simple  forms  described  through  mappings  be¬ 
tween  frames  of  discernment  that  are  called  compatibility  relations.  Two  classes  of  compatibility  relations, 
corresponding  to  deterministic  and  probabilistic  relationships,  are  investigated. 

The  results  presented  in  this  section  can  be  described  more  accurately  as  formulas  for  the  translation 
or  projection  of  knowledge,  rather  than  as  expressions  for  the  integration  of  distinct  evidential  bodies.  The 
developments  described  in  this  section,  however,  generalize  previous  results  of  the  Dempster-Shafer  theory, 
emphasizing  the  conceptual  power  of  the  formal  structures  presented  in  previous  sections.  More  importantly, 
as  discussed  in  detail  below,  these  developments  provide  insight  into  the  nature  of  problems  entailed  in 
combining  evidence  under  various  assumptions  of  probabilistic  dependence.  These  combination  formulas  are 
derived  and  studied  in  a  related  work  [15]. 

VI-1.  Compatibility  Between  Frames  of  Discernment 
VI-1-1.  Probabilistic  Compatibility  Relations 

If  the  probabilistic  distribution  of  the  state  of  knowledge  of  a  rational  agent  is  a  function  of  the  state 
of  knowledge  of  another  rational  agent,  then  a  probability  distribution  characterizing  the  uncertainty  of  the 
latter  can  be  used  to  derive  the  probability  distribution  for  the  states  of  knowledge  of  the  former. 

Theorem:  Let  P  be  the  epistemic  probability  induced  in  i/©(Si  ®  S2)  by  a  probability  P  defined  in 
the  product  epistemic  algebra  flefi/x)  ofU(Si)  x  Zi ( S2 ) •  Assume  that  P(II®)  >  0. 

Further,  assume  that  the  conditional  mass  assignments  with  respect  to  an  objective  sentence  Si  are 
given  by  the  function 

m(<?2/  <fi)  =  P(e2(<f2)/ei(<fi)) , 

defined  in  $(S 2 )  for  every  Si  in  $(Si)  such  that  P(ei((?i))  >  0. 

Assume  afso  that  m(<f2/i?i)  —  0  if  ei(<fi)  x  e2(<f2)  g  11®. 

Let  m  and  mi  be  the  probability  masses  associated  with  P  in  the  subset  algebras  He (£i®)  and  0^.(1/®), 
respectively.  If  S  is  in  $(Si  ®  S2),  then 

m(S)=  22m(£a/£i)mi(Si),  (VI.  1) 

r  (f) 

where  the  sum  is  over  all  pairs  (Si,  S2)  in  <I>(Si)  X  $(S2)  such  that  (Si,  S2)  is  in  r(<f). 
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Proof:  Since  m(£ 2/cfi)  —  0  whenever  ei(£i)  x  e2(£2)  £  IIg,  and  since 

J3m(<f2/<fi)  =  P^iffiJ/e^^))  =  1, 

then,  if  denotes  a  sum  over  all  f2  in  $(£2)  such  that  the  pair  (£1,  <f2)  is  in  T(£),  it  is 

£7 

Em(f)  ■  EE*™^2/^)™^)  =  E-^)E-(W) =  1- 

£  £1  £2  £\  £1 

Therefore,  k  =  P(II®)  =  1,  and  the  theorem  follows  at  once  from  the  additive  combination  theorem. I 
VI-1-2.  Deterministic  Compatibility  .Relations 

Assume  now  that,  to  each  sentence  £j  in  the  frame  of  discernment  $(£1)  there  corresponds  a  sentence 
in  the  frame  of  discernment  ${S2),  defined  by  a  mapping 


®(5i)  i- +  $(S2), 

which  in  turn  defines  a  conditional  probability  P(  •  /ei(£i))  which  is  focused  on  the  sentence  ^(£1)  in  the 
frame  of  discernment  $(S2)  with  an  associated  probability  mass  assignment  given  by 

•  r  e  /  e  ^  _  /  1>  ll  £2  — 

othenvise. 

In  this  case,  the  formula  of  the  above  theorem  can  be  simplified  to 


m(<?)  =  ^  mi(<fi),  £  in  3>(Si  ®  S2) , 

r(f) 

where  the  sum  is  over  all  £1  in  Si  such  that  (Si^fSi))  is  in  T(£). 

If,  for  a  given  <f2  in  $>(S2),  the  left  hand  sides  are  now  added  over  all  sentences  £  in  the  frame  of 
discernment  $(Si®S2)  such  that  (fj,  <f2)  =  (Si,?r(Si)),  then  the  familiar  result  for  the  marginal  probability 
mass  m2  is  obtained: 

^(£2)  =  E 

This  result  is  usually  described  as  a  translation  formula  that  allows  mapping  of  probabilistic  knowledge 
defined  on  one  frame  of  discernment  into  another  frame  of  discernment  related  to  the  former  by  deterministic 
compatibility  relations. 


VI- 1-3.  Dependence  on  Support  Sets 

We  will  now  discuss  the  combination  of  dependent  knowledge  when  conditional  mass  functions  defined 
on  one  frame  of  discernment  as  a  function  of  the  known  truth  of  a  sentence  in  another  frame  of  discernment 
have  been  provided.  Unlike  previous  examples,  where  it  was  assumed  that  dependence  information  was 
available  in  the  form  of  the  conditional  probability  values  P(e2(<f2)/ei{fi)),  we  shall  now  assume  that 
information  is  provided  in  the  form  of  the  conditional  probability  functions 


P(  -/ki(£i))  :  ^e(^x)  >-♦  [0, 1] , 


defined  for  every  marginal  epistemic  support  set  ki(£i),  with  £1  in  $(Si),  such  that  P(ki{£i))  >  0. 

Note  that,  if  such  information  is  provided,  the  marginal  probabilities  for  the  marginal  algebra  O^(Ux) 
are  known  because 


m2(£2)  =  P(S2(£2))  =  P(e2(f2)  /ki(eO)  . 

Moreover,  any  specification  of  the  conditional  probability  P(  ■  /lei (<Ti))  must  be  expected  to  be  further 
constrained,  as  shown  by  the  following  proposition: 
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Proposition:  Assume  that  P  is  a  probability  debited  in  the  product  epistemic  algebra  o fU(S\)  X  1/(52). 
Let 

with  <fi  in  $(5i),  <?2  in  $(52)/  snd  assume  also  that  P(ki(<fi))  >  0.  Further,  let  Si  be  the  support  function 
associated  with  P  in  the  marginal  epistemic  algebra  fig  of  LI  {Si)  X  1/(52). 

Then,  for  every  <f2  in  $(52),  the  function 

Si(  ■  0  52)  :  $(5i)  •->  [0,  l]  |  <£2  in  $(52), 


defined  by 

Si  (5i  0  £2)  =  P(iti(5i)  PI  62(^2))  =  fh{£ 2 / 5i)  5i(5i) , 

satisfies  Shafer’s  axiom  IJJ.5. 

Proof:  The  proposition  follows  immediately  from  the  relation 

hi(5i)  ne2(<?2)  =  (J  [ei(^)  n  62(^2)]  , 

where  the  union  is  over  all  Q  in  $(5i)  such  that  Q  =>  £1,  by  application  of  the  combinatorial  theory  results 
leading  to  the  inequality  III.5.I 

Corollary: 

*i(<ri0  52)=P{e1(5i)ne2(52))  =  Y,  (-l)|fl"sl5i (£0  52), 

5=>£i 

where  the  sum  is  over  all  Q  in  $(5i)  such  that  §  =>  £\. 

Proof:  Follows  at  once  from  the  above  proposition  by  application  of  the  Mobius  inversion.! 

By  combining  these  results  with  the  additive  combination  theorem,  it  is  possible  to  derive  the  main 
result  of  this  section: 

Theorem:  Let  the  functions  m(-/-)  and  Fi(-  0  •)  be  defined  as  before.  Assume  also  that 

m(£2/£i)=0,  if  ei(<?i)  X  e2(<f2)  £  II®. 

If  £  is  in  $(5X  0  52),  then  it  is 

m(£)  =  E  *1(^1  0  &) 

r(tr) 

=  EE  (-i)|fl“5|si(5  0^) 

r(£)  s=>f. 

=  E  E  (-1  f'-s'Hb/SWS), 

T{£)  1 

where  the  sum  is  over  all  pairs  (£1,  <f2)  in  $(5i) X  $(52)  such  that  (5i,  £2)  is  in  T(5)  and  over  all  §  in  $(5i), 
such  that  Q  =>  £1. 

Proof:  Follows  immediately  from  the  additive  combination  theorem  and  the  fact  that  k  —  1  (proved  as 
was  done  before  when  probabilistic  compatibility  relations  were  discussed).! 
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VI-2.  The  Combination  of  Dependent  Evidence 

The  results  presented  in  this  and  previous  sections  illustrate  the  important  role  of  the  results  discussed 
in  Section  IV  (particularly  the  additive  combination  theorem)  for  the  derivation  of  evidence  combination 
rules  under  a  wide  variety  of  assumptions  about  the  nature  of  the  evidential  bodies  being  combined  and 
their  relations. 

The  basic  framework  in  any  such  problem  consists  of  the  specification  of  probabilities  over  the  marginal 
epistemic  algebras  of  the  Cartesian  product  U{Si)  x  Zi (^2) -  These  probability  functions  will  always  be 
consistent,  since  there  will  always  exist  a  probability  defined  over  the  product  epistemic  algebra  De(^x) 
that  extends  a  probability  defined  on  both  0^(1/ * )  and  in  £1%(U  * )  (for  example,  that  leading  to  the  Dempster 
combination  formula)6. 

In  addition  to  these  probabilities,  which  characterize  the  uncertainties  inherent  in  each  evidential  body, 
other  probabilities  may  be  defined  over  certain  subalgebras  fl  of  the  product  epistemic  algebra  De(Z/x)-  For 
example,  in  the  case  of  the  Dempster  formula,  a  probability  is  defined  directly  over  that  algebra  by  means 
of  the  independence  assumption  (i.e.,  defining  a  value  for  P(ei(f1)  x  62(^2))  as  a  function  of  the  values  of 
the  marginal  probabilities).  Similarly,  in  the  cases  studied  in  this  section,  the  conditional  values  1) 

specify  (together  with  the  mass  assignment  mi)  probabilities  over  members  of  De(Z/x)  hi  a  straightforward 
manner. 

The  probabilities  specified  over  fi  must  be  consistent,  however,  with  the  marginal  probabilities  defined 
over  the  marginal  epistemic  algebras  Dj.  and  fi|..  If  the  constraining  probabilities  are  consistent  with  the 
marginal  distributions,  the  problem  of  combination  reduces  to  that  of  extending  P  (defined  over  the  marginal 
epistemic  algebras  and  fl)  to  the  product  epistemic  algebra  De,  thus  allowing  application  of  the  results  of 
Section  IV.  As  seen  in  Section  III,  this  is  equivalent  the  computation  of  the  lower  probabilities  induced  by 
P. 

For  example,  in  an  important7  and  more  complex  problem  involving  three  mutually  independent  bodies 
of  evidence,  probabilities  are  specified  in  three  marginal  epistemic  algebras  of  the  Cartesian  product 

Hx  =U[Sl)xU{S2)  X  U[S9). 

These  probabilities  represent  the  results  Pj2  and  P13  of  combining  one  body  of  evidence  with  each  of 
the  other  two  (corresponding  to  probability  specification  over  the  marginal  algebras  (Zix)  and  ^e  (^x)> 
defined  in  a  way  that  naturally  extends  the  definitions  of  Section  IV)  plus  actual  knowledge  of  the  probability 
over  the  marginal  epistemic  algebra  f2j-(Zfx)-  These  interrelated,  consistent,  probability  functions  must  be 
combined  so  as  to  extend  P  to  the  product  epistemic  algebra  De(Z/x))  thus  allowing  application  of  the  results 
of  Section  IV. 

A  detailed  treatment  of  these  problems  is  given  in  a  related  paper  [15], 


c  Note,  however,  that  conditioning  with  respect  to  the  subset  II@  of  if  (Si)  x  lf(Sj)  may  be  impossible  as  P(JI@)  may  be 
equal  to  zero  indicating  inconsistence  of  the  bodies  of  evidence. 

7  The  importance  of  this  problem  derives  from  its  practical  application  to  the  combination  of  evidential  bodies  sharing 
common  knowledge. 
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